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Summary rel 2011-No. 105 

Title III accountability policies 
and outcomes for K-12: annual 
measurable achievement objectives 
for English language learner students 
in Southeast Region states 



This report overviews key elements of 
the Title III annual measurable achieve- 
ment objectives (AMAO) in the South- 
east Region states for 2007/08: number 
and type of Title III subgrantees, Eng- 
lish language proficiency assessments 
used, and state and subgrantee perfor- 
mance in meeting AMAO accountability 
targets. 

This report details Title III accountability 
policies and outcomes for K-12 English lan- 
guage learner (ELL) students for school year 
2007/08 in the six Southeast Region states 
(Alabama, Florida, Georgia, Mississippi, 
North Carolina, and South Carolina) under 
the Title III annual measurable achieve- 
ment objectives (AMAO) provision of the No 
Child Left Behind (NCLB) Act of 2001. The 
AMAO provision of Title III is an account- 
ability mechanism designed specifically for 
ELL students. It applies to states and their 
subgrantees (educational entities, usually 
districts that serve ELL students) that receive 
federal Title III funds to improve programs 
and education outcomes for ELL students. 
Title III formula grants are disbursed to all 
U.S. states and territories. 



The three AMAOs are: 

• AMAO 1: The number or percentage of 
students served by Title III demonstrating 
progress in English language proficiency. 

• AMAO 2: The number or percentage of 
students served by Title III that attain full 
English language proficiency. 

• AMAO 3: Whether the ELL student 
subgroup made adequate yearly progress 
in academic achievement, as required by 
Title I of NCLB. 

States can define the details of their AMAOs 
and set their annual targets through school 
year 2013/14. Each year they must report 
whether the state as a whole met its AMAO 
targets and how many of its subgrantees 
did so. 

This report responds to state education agency 
requests for information on Title III AMAO 
policies in the Southeast Region and is in- 
tended to help state education agency staff 
as they revise and implement their required 
accountability policies for monitoring the 



SUMMARY 



achievement of students not yet fluent in 

English. 

This study is driven by five research questions: 

• How many and what type of Title III sub- 
grantees did each state have in 2007/08? 

• What English language proficiency assess- 
ments did each state use? 

• How did each state define AMAO 1, and 
what accountability determinations did 
each state report? 

• How did each state define AMAO 2, and 
what accountability determinations did 
each state report? 

• How did each state define AMAO 3, and 
what accountability determinations did 
each state report? 

The report is based on publicly available 

documents. 

Key findings include: 

• All six states had district subgrantees. 

In two states, all the subgrantees were 
districts. In four states, some subgrantees 
were consortia (groups of districts that 
joined together to pool their funds). In one 
state, one subgrantee was a charter school. 

• The six states used five different English 
language proficiency assessments. Two 
states used Assessing Comprehension and 
Communication in English State-to-State 
for English Language Learners (ACCESS 
for ELLs); the other four states each used 



a different assessment. All the tests as- 
sessed students in the domains of listen- 
ing, speaking, reading, and writing; one 
state also assessed comprehension. The 
assessments varied by the types of com- 
posite scores (combined domain scores) 
reported and by the overall fluency levels 
reported (how they divided the continuum 
of language acquisition from no English 
proficiency to fluency). 

• All six states’ AMAO 1 definitions entailed 
measuring the annual change in English 
language proficiency assessment scores 
(comparing 2007/08 with 2006/07). There 
were three differences in these definitions. 
For calculations, states either grouped all 
students together or grouped them into 
cohorts established according to varying 
criteria. States differed in the assessment 
scores they used and the level of increase 
required to constitute progress. States 

set different targets for the percentage 
of students that had to show progress in 
order for the state and subgrantees to meet 
AMAO 1. All states but Mississippi, and 
varying numbers of subgrantees within 
each state, reported meeting AMAO 1. 

• All six states’ AMAO 2 definitions in- 
volved comparing 2007/08 assessment 
scores with those required to meet the 
state’s definition of proficiency. There 
were three differences in these definitions. 
For calculations, states either grouped all 
students together or grouped them into 
cohorts established according to varying 
criteria. States differed in the assessment 
scores they used and the score required 

to constitute proficiency. States set differ- 
ent targets for the percentage of students 
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that had to reach proficiency in order for 
the state and subgrantees to meet AMAO 
2. All six states, and varying numbers of 
subgrantees within each state, reported 
meeting AMAO 2. 

All six states’ AMAO 3 definitions were 
based on the state’s definition of adequate 
yearly progress as established for Title I. 
The state achievement tests and targets 
for assessing adequate yearly progress 
were those used for the student popula- 
tion as a whole, including the ELL student 
subgroup; each state had its own tests and 
targets. To trigger a Title I determination 
of adequate yearly progress for the ELL 
student subgroup, the number of ELL 
students in a district had to meet each 
state’s established minimum. The number 
of subgrantees in the states that met this 



requirement varied. Of the six states’ sub- 
grantees receiving such determinations, 
the number that met AMAO 3 varied, 
five states did not report AMAO 3 results 
for districts that did not receive adequate 
yearly progress determinations; one state 
reported these districts as meeting AMAO 
3 by default. 

Given these variations in the numbers and 
types of subgrantees across states, the English 
language proficiency assessments they used, 
how AMAOs were defined, and the targets 
they set, the 2007/08 AMAO 1, 2, and 3 deter- 
minations reported different indicators across 
states. Common interpretations of the results, 
and thus comparisons among states, are not 
possible. 
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This report 
overviews key 
elements of the 
Title III annual 
measurable 
achievement 
objectives 
(AMAO) in the 
Southeast 
Region states for 
2007/08: number 
and type of Title 
III subgrantees, 
English language 
proficiency 
assessments 
used, and state 
and subgrantee 
performance in 
meeting AMAO 
accountability 
targets. 



WHY THIS STUDY? 

This report details Title III accountability policies 
and outcomes for K-12 English language learner 
(ELL) students for school year 2007/08 in the 
six Southeast Region states (Alabama, Florida, 
Georgia, Mississippi, North Carolina, and South 
Carolina; for definitions of key terms, see box 1). It 
intends to inform the work of states as they revise 
these required accountability policies — known 
as annual measurable achievement objectives 
(AMAO) — for monitoring the achievement of 
students not yet fluent in English. 

The No Child Left Behind (NCLB) Act of 2001 
specifies two accountability provisions for ELL 
student academic achievement: Title III AMAOs 
and Title I adequate yearly progress reports. The 
Title III AMAO provision is the accountability 
mechanism for states and their subgrantees that 
receive Title III funds (No Child Left Behind 2001, 
2002a, 2008b). The Title I adequate yearly progress 
provision is the general accountability mechanism 
for all students, including ELL students. 

Title III formula grants are disbursed annually to 
state education agencies, which provide subgrants 
to eligible entities— typically districts— that serve 
ELL students. Title III funds are meant to improve 
programs and education outcomes for ELL stu- 
dents, so that they can attain English proficiency, 
develop high academic attainment in English, and 
meet the same state academic content and achieve- 
ment standards that all children are expected to 
meet (No Child Left Behind 2002a). State educa- 
tion agencies use these funds to establish English 
language proficiency standards and assessments 
for ELL students, provide professional develop- 
ment for educators and technical assistance to sub- 
grantees, monitor subgrantees’ use of the funds, 
and report annually on the status of the AMAOs. 1 
Subgrantees use the funds to develop and improve 
instructional programs for ELL students. These 
programs may include one or more methods of 
instruction grounded in scientific research. Sub- 
grantees also use the funds to provide professional 
development for teachers and to annually assess 





2 



TITLE III ACCOUNTABILITY POLICIES AND OUTCOMES FOR K-12 



BOX 1 

Key terms 

Adequate yearly progress. Title I re- 
quires that states set adequate yearly 
progress targets in three areas: stu- 
dent participation in state academic 
assessments; student achievement in 
reading/English language arts and 
math (at a minimum), measured in 
grades 3-8 and once in high school 
(states set targets toward 100 percent 
proficiency by 2014); and a “second 
academic indicator,” typically the 
attendance rate for elementary and 
middle schools and the graduation 
rate for high schools. Schools and 
districts failing to make adequate 
yearly progress for multiple years face 
specific consequences, from offering 
students alternative learning oppor- 
tunities to school restructuring. 

Adequate yearly progress subgroups. 
Students are classified into subgroups 
based on English language learner 
(ELL) status, race/ethnicity, socio- 
economic status (determined by eligi- 
bility for free or reduced-price lunch), 
and special education status. States, 
districts, and schools must report 
whether they meet adequate yearly 
progress targets for all students and 
for each student subgroup that meets 
the minimum size established by 
the state to generate valid statistical 
calculations. 

Annual measurable achievement 
objective (AMAO) 1 (English language 
learner [ELL] student progress in Eng- 
lish). The first AMAO outlined in the 
accountability section of Title III of 
the No Child Left Behind Act (NCLB) 
of 2001. States and their subgrantees 
receiving Title III funds must report 



annually whether they achieve their 
growth targets for the number or 
percentage of students demonstrat- 
ing progress in English proficiency 
in listening, speaking, reading, and 
writing. 

AMAO 2 (ELL student English profi- 
ciency). The second AMAO outlined 
in the accountability section of Title 
III of NCLB. States and their sub- 
grantees receiving Title III funds 
must report annually whether they 
achieve their growth targets for the 
number or percentage of students 
that attain full English proficiency. 

AMAO 3 (adequate yearly progress 
for ELL student academic achieve- 
ment). The final AMAO outlined in 
the accountability section of Title III 
of NCLB. States and their subgrantees 
receiving Title III funds must report 
annually whether they make ad- 
equate yearly progress as required 
by Title I of NCLB. Whereas AM AOs 
1 and 2 relate specifically to English 
language proficiency (and are based 
on an English language proficiency 
assessment), adequate yearly progress 
is a measure of student academic 
achievement in the content areas 
and is based on state content area 
academic assessments. 

English language learner (ELL) 
students (also referred to as limited 
English proficient students in Title III 
legislation). Students whose native 
language is not English and whose 
difficulties in English limit their 
ability to perform proficiently on the 
state’s achievement test, to success- 
fully participate in classes in which 
only English is spoken, and to partici- 
pate fully in society. 



English language proficiency assess- 
ment. Tests of English language 
proficiency used annually by states. 
Title III states that these assessments 
must provide valid and reliable mea- 
surements of ELL student proficiency 
in the language domains of listening, 
speaking, reading, and writing. 

No Child Left Behind (NCLB) Act of 
2001. The most recent reauthoriza- 
tion of the Elementary and Second- 
ary Education Act. NCLB establishes 
requirements for how states, districts, 
and schools spend federal funds 
to maintain and improve public 
education. 

Subgrantee. Eligible entities, typi- 
cally individual districts and groups 
of districts that pool funds and share 
resources (consortia), that receive 
Title III funds from their state. Sub- 
grantees use the funds to develop 
and improve instructional programs 
for ELL students, provide profes- 
sional development to teachers of ELL 
students, and annually assess ELL 
students’ English proficiency. 

Title 1. A federal grant program for 
states, districts, and schools that 
serve high percentages of students 
from low-income households, from 
pre-K through high school. Funds 
can support programs and account- 
ability measures. 

Title III. A federal grant program for 
state education agencies to support 
the education of ELL students. State 
education agencies provide subgrants 
to eligible entities, usually districts, 
that serve ELL students. States sup- 
port and monitor subgrantees’ use of 
the funds. 
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ELL student English proficiency (No Child Left 
Behind 2002a, c,d; U.S. Department of Education 
2003). 

States can define the details of their AMAOs and 
set the annual targets through school year 2013/14, 
Each year, states must report whether the state as 
a whole met the targets and how many of its sub- 
grantees did so. The AMAOs are: 

• AM AO 1: The number or percentage of 
students served by Title III demonstrating 
progress in English language proficiency. 

• AMAO 2: The number or percentage of 
students served by Title III that attain full 
English language proficiency. 

• AMAO 3: Whether the ELL student subgroup 
made adequate yearly progress in academic 
achievement, as required by Title I of NCLB. 

This report addresses five research questions: 

• How many and what type of Title III sub- 
grantees did each state have in 2007/08? 

• What English language proficiency assess- 
ments did each state use? 

• How did each state define AMAO 1, and what 
accountability determinations did each state 
report? 

• How did each state define AMAO 2, and what 
accountability determinations did each state 
report? 

• How did each state define AMAO 3, and what 
accountability determinations did each state 
report? 

The first two questions concern background infor- 
mation needed to understand AMAO policies. The 
last three address AMAO policies and reported 
determinations for the 2007/08 school year. At 
the time of data collection, 2007/08 was the most 



recent school year for 
which data on policies 
and corresponding deter- 
minations were available 
for all six states. (The data 
sources are presented in 
appendix A.) Some of the 
English language profi- 
ciency tests were new in 

the states at the time of data collection, so multi- 
year trends could not be studied. 



The numbers and 
types of Title III 
subgrantees, the English 
language proficiency 
assessments they use, 
and how AMAOs are 
defined vary by state 



State education agency staff in the Southeast Re- 
gion requested this report to provide a multistate 
perspective as they work to meet their AMAOs. 
Because AMAOs are new under NCLB, many states 
have found establishing their AMAO policies to 
be a challenge (American Institutes for Research 
2010a, b). In 2008, the U.S. Department of Education 
published new Title III interpretations, clarifying 
AMAO requirements (box 2; Federal Register 2008; 
National Clearinghouse for English Language Ac- 
quisition 2009a). All states have since had to review 
their AMAO policies to ensure compliance. 

The numbers and types of Title III subgrantees, 
the English language proficiency assessments 
they use, and how AMAOs are defined vary by 
state, making it impossible to draw common 
interpretations across states or compare state 



BOX 2 

U.S. Department of Education 2008 revised 
interpretations of Title III of the No Child Left 
Behind Act of 2001 

In October 2008, the U.S. Department of Education pub- 
lished revised interpretations of Title III, with updated 
requirements for state English language proficiency 
assessments and annual measurable achievement objec- 
tives (Federal Register 2008). These revised interpreta- 
tions responded to questions from the field in recent 
years (U.S. Department of Education 2008). A summary 
of all 10 revised interpretations, adapted from the Na- 
tional Clearinghouse for English Language Acquisition 
(U.S. Department of Education 2008), is in appendix C. 
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determinations. Therefore, this report describes, 
but does not compare, AMAO policies and de- 
terminations for school year 2007/08 to inform 
efforts of state education agency staff to help their 
school districts achieve the objectives. 



CONTEXT FOR UNDERSTANDING 
TITLE III ANNUAL MEASURABLE 
ACHIEVEMENT OBJECTIVES 



Many states’ K-12 ELL student populations have 
grown in recent years. Nationally, ELL student 
enrollment increased 57 percent over 1995-2005 
(Maxwell 2009). Public schools educated 4.7 mil- 
lion ELL students in 2007/08, almost 10 percent 
of national public school enrollment (American 
Institutes for Research 2010a). Of these 4.7 million, 
4.4 million (94 percent) were enrolled in districts 
receiving Title III funds in 2007/08 (American Insti- 
tutes for Research 2010b). for fiscal year 2008, the 
federal government awarded states $78.1 million in 
Title III funds (U.S. Department of Education n.d.a). 



Increases in the number of ELL students are 
expected to continue, with immigrant and ELL 
students projected to account for most of the 
growth in the U.S. school-age population over the 
next decade (fry 2008). The Southeast Region in 
particular is recognized as a new immigrant des- 
tination (Anderson 2009; Zuniga and Hernandez- 
Leon 2005). It already has the second-largest K-12 
ELL student population in the country after the 
West Region (Meyer, Madden, and McGrath 2004). 
(See appendix D for data on ELL enrollment and 
languages spoken by ELL students in the South- 
east Region states in 2007/08.) 



One initial challenge 
for states in developing 
their AMAO policies was 
selecting an English 
language proficiency 
assessment to measure 
ELL student progress 
and proficiency 



ELL students across the country 
have lagged behind national aver- 
ages in achievement. The results 
of the 2009 National Assessment 
of Educational Progress (NAEP) — 
“the nation’s report card” — show 
wide disparities (National Assess- 
ment of Educational Progress 
2009). On the NAEP math test, 



just 12 percent of grade 4 ELL students scored at or 
above proficiency, compared with 38 percent of all 
students in the country. In grade 8, just 5 percent 
of ELL students scored at or above proficiency, 
compared with 33 percent of all students (National 
Center for Education Statistics 2009a). On the 
NAEP reading test, just 6 percent of grade 4 ELL 
students scored at or above proficiency, compared 
with 32 percent of all students. And in grade 8, just 
3 percent of ELL students scored at or above pro- 
ficiency, compared with 30 percent of all students 
(National Center for Education Statistics 2009b). 

Given such wide disparities in achievement, 
improving education outcomes for ELL students 
has become a vital policy concern for states and 
an increasing challenge for districts (American 
Institutes for Research 2010b, c). To address lag- 
ging achievement, many states and districts have 
increased efforts to train teachers of ELL students 
and to launch new ELL instruction initiatives 
(Honowar 2009). 

Although all 50 states implement AMAOs, this 
type of accountability was new for states under 
Title III of the NCLB Act (American Institutes for 
Research 2010a). Thus, as states set out to make 
the complex sequence of decisions underlying 
the development of their AMAO policy, little 
information was available to support them. One 
initial challenge for states was selecting an English 
language proficiency assessment to measure 
ELL student progress (AMAO 1) and proficiency 
(AMAO 2). NCLB requires that state English 
language proficiency assessments measure growth 
over time and align with state academic content 
standards. Before NCLB, many states either used 
an English language proficiency assessment 
designed only for student placement (that is, not 
for measuring growth over time) or did not have 
an English language proficiency assessment at all 
(American Institutes for Research 2010a). 

A second challenge for states was how to define 
ELL student progress and proficiency (American 
Institutes for Research 2010a; Linquanti and 
George 2007; Linquanti 2007; Cook et al. 2008). 
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States had to decide how much annual improve- 
ment in English proficiency is required to “make 
progress” and what scores on the English language 
proficiency assessment would be used to deter- 
mine progress and to establish “proficiency,” as 
well as estimate the time students needed to reach 
this point. 2 The findings in this report detail how 
the six Southeast Region states dealt with these 
complexities. 

The methodology for this study involved organiz- 
ing and presenting information from multiple 
publicly available documents from each state 
(box 3). (The methodology is described in detail in 
appendix A; state profiles are in appendix E.) 



FINDINGS 



Numbers and types of Title III subgrantees. 
States varied in the type and number of Title 
III subgrantees reported in 2007/08. Sub- 
grantees included districts, consortia (groups 
of districts that join together to pool funds 
and share resources), and a charter school 
(North Carolina). The number of subgrantees 
varied from 23 in Mississippi to 85 in North 
Carolina. States made subgrants to these enti- 
ties based on how many ELL students they 
served (the minimum award was $10,000; U.S. 
Department of Education n.d.b). 

English language proficiency assessments used. 
Five different English language proficiency as- 
sessments were used across the six states. The 
assessments differed in their format, language 
domains assessed, and scores generated. 



This section describes the key elements of the • Definition of and accountability determina- 

Title III AM AOs in the Southeast Region states for tionsfor AMAO 1. The six states differed in 

school year 2007/08: how they grouped students for calculations, 



BOX 3 

Data sources and methodology 

This report draws on the following 

types of documents: 

• Consolidated state accountability 
workbooks (documents outlining 
each state’s plan for meeting the 
requirements for state account- 
ability systems under the No 
Child Left Behind [NCLB] Act of 
2001 ). 

• Consolidated state performance 
reports (the annual reporting 
tool for each state to report 
data on its implementation 

of the various components of 
NCLB). 

• State English language profi- 
ciency assessment information. 



• State-reported annual measur- 
able achievement objectives 
(AMAO) policy documents and 
determinations data. 

Most documents were accessed 
through state education agency 
websites. Some documents were sent 
to the researchers by state Title III 
staff. State staff were informed of the 
study’s purpose and how the data 
were to be used. 

Once the source documents for each 
state were gathered, a protocol was 
used to organize each state’s informa- 
tion on the number and type of Title 
III subgrantees, the English language 
proficiency assessments used, how 
students were counted in calculations 
of determinations, the parameters 
used to define each AMAO, the an- 
nual targets, and the actual reported 
determinations for subgrantees and 



for the state in 2007/08. (A copy of the 
protocol is in appendix B.) In a few 
cases, a state had inconsistencies across 
its source documents. (For example, 
the number of subgrantees meeting 
one of the AMAOs, as reported in a 
state’s consolidated state performance 
report, did not match that in the state’s 
determinations data, as posted on the 
state education agency website.) In 
such cases, researchers contacted the 
state education agency Title III director 
to resolve the inconsistency. 

This methodology has several limita- 
tions. The report describes AMAOs in 
just six states for one year; its findings 
may not reflect other states or the same 
states in other years. Some states have 
changed their AMAO policies since 
data collection was completed. These 
changes have been noted in endnotes. 
Additional changes might have been 
made since the report was written. 
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how they defined student progress, whether 
they set single or multiple targets, and the tar- 
gets set. In addition, the definition of student 
progress depended on English language pro- 
ficiency assessments that differed across the 
six states. All states but Mississippi reported 
meeting AMAO 1. Varying numbers of sub- 
grantees in each state met AMAO 1. 

Definition of and accountability determina- 
tions for AMAO 2. The six states differed in 
how they grouped students for calculations, 
how they defined student proficiency, whether 
they set single or multiple targets, and the tar- 
gets set. In addition, the definition of student 
proficiency depended on English language 
proficiency assessments that differed across 
the six states. All six states reported meeting 
AMAO 2. Varying numbers of subgrantees in 
each state met AMAO 2. 

Definition of and accountability determinations 
for AMAO 3. Each state defined AMAO 3 based 
on its definition of adequate yearly progress 
under Title I. States differed in the minimum 
number of students that subgrantees needed to 
calculate adequate yearly progress for the ELL 
student subgroup, the academic content area 
assessments used and grade levels included, 
and the targets set. Varying numbers of sub- 
grantees receiving adequate yearly progress 



ELL student subgroup determinations made 
adequate yearly progress. Five states did not 
report an AMAO 3 determination for district 
subgrantees that did not receive an adequate 
yearly progress ELL student subgroup deter- 
mination; one state reported these districts as 
meeting AMAO 3 by default. 



How many and what type of Title III 
subgrantees did each state have? 

The number of subgrantees ranged from 23 in 
Mississippi to 85 in North Carolina (table 1). Four 
states (Alabama, Georgia, North Carolina, and 
South Carolina) had consortia subgrantees. In 
four states (Florida, Georgia, North Carolina, and 
South Carolina), at least 72 percent of all districts 
had access to Title III funds; in Alabama, 40 
percent of districts had access, and in Mississippi, 
15 percent did. (See appendix E for a description of 
each state’s subgrantee information.) 



What English language proficiency 
assessments did each state use? 

Five different English language proficiency assess- 
ments were used in the six Southeast Region states 
in 2007/08 (table 2). 

Each assessment had different tests for different 
grade spans: K (or pre-K)-2, 3-5, 6-8, and 9-12. 



TABLE 1 

Entities receiving Title III funding, by state, 2007/08 (number, unless otherwise noted) 



State 


Title III 
subgrantees 


District 

subgrantees 


Consortium 

subgrantees 


Districts 
represented 
in the 
consortia 


Charter 

school 

subgrantees 


Districts 
with access 
to Title III 
funding 


Total 

districts 


Districts 
with access 
to Title III 
funding 
(percent) 


Alabama 


51 


49 


2 


4 


0 


53 


131 


40 


Florida 


48 


48 


0 


0 


0 


48 


67 


72 


Georgia 


81 


80 


1 


83 


0 


163 


185 


88 


Mississippi 


23 


23 


0 


0 


0 


23 


152 


15 


North Carolina 


85 


82 


2 


14 


1 


96 


115 


83 


South Carolina 


44 


37 


7 


30 


0 


67 


85 


79 



Source: Authors' review of state documents on AMAO subgrantee and determinations. 
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TABLE 2 

English language proficiency assessment instruments used, by state, 2007/08 



State 


Assessment 


Year first used 


Assessment developer (website) 


Alabama 


ACCESS for ELLs 


2005 


World-Class Instructional Design and Assessment Consortium 
(www.wida.us/assessment/ACCESS/index.aspx) 


Florida 


Comprehensive English 
Language Learning 
Assessment 


2006 


Educational Testing Service (www.ets.org) 


Georgia 


ACCESS for ELLs 


2006 


World-Class Instructional Design and Assessment Consortium 
(www.wida.us/assessment/ACCESS/index.aspx) 


Mississippi 


Stanford English 
Language Proficiency 
Test a ’ b 


2004 


Pearson Education 11 (www.pearsonassessments.com/FIAIWEB/ 
Cultures/en-us/Productdetail.htm?Pid=015-8429-206) 


North 

Carolina 


IDEA English Language 
Proficiency Test b 


2005 


Ballard and Tighe (www.ballard-tighe.com) 


South 

Carolina 


English Language 

Development 

Assessment 


2005 (grades 
3-12), 2006 
(grades K— 2) 


Council of Chief State School Officers Limited English Proficiency 
State Consortium for Assessment and Student Standards, in 
collaboration with the American Institutes for Research, the 
Center for the Study of Assessment Validity and Evaluation at the 
University of Maryland, and Measurement Incorporated (http:// 
ed.sc.gov/agency/Accountability/Assessment/old/assessment/ 
programs/elda/elda.html) 



ACCESS for ELLs is Assessing Comprehension and Communication in English State-to-State for English Language Learners. 

a. Mississippi used a version of the test modified expressly for the state (K. Thompson, Director, Office of Research and Statistics, Mississippi Department of 
Education, personal communication, May 6, 2010). 

b. Mississippi and North Carolina joined the World-Class Instructional Design and Assessment Consortium and adopted the ACCESS for ELLs assessment in 
2008/09 (WIDA Consortium 2008, 2009c). 

c. Mississippi acquired its assessment materials from Harcourt Assessment, Inc. in 2007/08 (Y. Gilbert, Title III State Coordinator, Mississippi Department of 
Education, personal communication, May 6, 2010; Mississippi Department of Education 2007). 

Source: Authors' review of state documents on English language proficiency assessment. 



ACCESS for ELLs, used in Alabama and Georgia, 
included different versions of the test for students 
at different proficiency levels for each grade span 
(tier). 

Student scores on the English language proficiency 
assessments displayed both similarities and dif- 
ferences. All the assessments generated separate 
domain scores for listening, speaking, reading, 
and writing; the Stanford English Language 
Proficiency Test also generated a comprehension 
domain score (table 3), and all generated compos- 
ite scores (scores derived from combinations of 
domain scores). A composite score for listening/ 
speaking provides information on a student’s 
general oral language skills; a composite score 
for reading/writing provides information on a 
student’s general literacy skills. But not all the 



assessments generated the same composites. Five 
of the states’ assessments generated an overall, or 
total, composite score that combined all domains. 
Additionally, all the assessments assigned stu- 
dents an English proficiency level, but how these 
levels divided the continuum of growth from no 
proficiency to the level approximating a native 
English speaker differed (the names and numbers 
of the levels varied). (See appendix E for a descrip- 
tion of each state’s English language proficiency 
assessments.) 



How did each state define AMAO 1, and what 
accountability determinations did each state report? 

The components of the AMAO 1 definitions of 
growth in the number or percentage of students 
demonstrating progress in English proficiency in 
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TABLE 3 

English language proficiency assessment scoring, by state, 2007/08 



State 


Assessment 


Language domain scores 


Composite scores 


Proficiency levels 


Alabama 


ACCESS for ELLs 


Listening, speaking, 
reading, writing 


Oral language (listening/ 
speaking), literacy (reading/ 
writing), comprehension 
(listening/reading), overall 


1: Entering 
2: Beginning 
3: Developing 
4: Expanding 
5: Bridging 
6: Reaching 


Florida 


Comprehensive 
English Language 
Learning 
Assessment 


Listening, speaking 3 , 
reading, writing 


Oral language (listening/ 
speaking), total 


1: Beginner 
2: Low intermediate 
3: High intermediate 
4: Proficient 


Georgia 


ACCESS for ELLs 


Listening, speaking, 
reading, writing 


Oral language (listening/ 
speaking), literacy (reading/ 
writing), comprehension 
(listening/reading), overall 


1: Entering 
2: Beginning 
3: Developing 
4: Expanding 
5: Bridging 
6: Reaching 


Mississippi 


Stanford English 
Language 
Proficiency Test 


Listening, speaking, 
reading, writing, 
comprehension 


Oral language (listening/ 
speaking, or "social" score for 
students at prereading levels), 
total 


1: Preproduction 
2: Early production 
3: Emergent 
4: Intermediate 
5: High intermediate 
6: Transitional 


North 

Carolina 


IDEA English 
Language 
Proficiency Test 


Kindergarten 

Reading/writing 

Listening/speaking 

Grades 1-12 
Listening, speaking, 
reading, writing 


Comprehension (listening/ 
reading) 


1: Novice low 
2: Novice high 
3: Intermediate low 
4: Intermediate high 
5: Advanced 
6: Superior 


South 

Carolina 


English Language 

Development 

Assessment 


Listening, speaking, 
reading, writing 


Comprehension 

(listening/reading), 

overall 


0-1: Prefunctional 
2: Beginning 
3: Intermediate 
4: Advanced 

5: Fluent English proficient 



Access for ELLs is Assessing Comprehension and Communication in English State-to-State for English Language Learners. 

a. Students received separate raw scores for the listening and speaking domains. The two scores were then combined to yield a listening/speaking score and 
proficiency level. Listening/speaking, reading, and writing (which receive both scale scores and proficiency levels) are the domains used for Florida's AMAO 1 
and AMAO 2 targets. 

Source: Authors' review of state English language proficiency assessment documents. 



listening, speaking, reading, and writing differed 
by state. The states differed in how they grouped 
students for calculations, how they defined student 
progress, whether they set single or multiple 
targets, and the targets set. The states used five dif- 
ferent English language proficiency assessments, 
against which they defined progress. As a result, 
determinations cannot be interpreted consistently 
across states, precluding comparisons. 



State definitions. To define AMAO 1, states first 
determined how to group students for calculations 
(table 4). Three states (Florida, North Carolina, 
and South Carolina) counted all ELL students 
as one group. The other three (Alabama, Geor- 
gia, and Mississippi) placed students in cohorts, 
organized either by how long students had spent in 
a language instruction program or by English lan- 
guage proficiency assessment score the previous 
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year. (In Alabama, the cohorts were organized by 
performance and grade span; in Georgia, by seven 
performance bands based on the previous year’s 
ACCESS for ELLs scores.) Appendix E details the 
states’ cohort organization. 

States defined progress based on improvement in 
English language proficiency assessment scores in 



2007/08 from those in 2006/07 (table 5). Students 
had to increase their score by at least one profi- 
ciency level in at least one language domain or in- 
crease their overall composite score. In Alabama 
and Georgia, students were required to achieve 
a certain minimum increase in their overall 
composite score, based on their cohort placement. 
(The actual minimum increase amounts required 



TABLE 4 

Methods of grouping English language learner students to calculate AMAO 1 performance, by state, 2007/08 



State 


All students counted 
together 


Students counted by cohort based on 


Previous year's English 
language proficiency 
assessment score 


Previous year's English 
language proficiency 
assessment score 
and grade level 


Number of years 
enrolled in a language 
instruction program 


Alabama 






✓ 




Florida 


✓ 








Georgia 3 




✓ 






Mississippi 








✓ 


North Carolina 


✓ 








South Carolina 


✓ 









AMAO is annual measurable achievement objective. 

a. Students were included in AMAO 1 calculations in 2007/08 only if present for the "full academic year" (present at both the fall and spring full-time equiva- 
lent attendance counts), the same mechanism used to determine state education funding for local school systems. After 2007/08, Georgia eliminated the full 
academic year requirement from its AMAO 1 determinations (Georgia Department of Education 2009). 

Source: Authors' review of state AMAO policy documents. 



TABLE 5 

AMAO 1 definitions of student progress, by state, 2007/08 



State 


By language domain score 


By overall composite score 


Increase score on English language 
proficiency assessment at least 
one level from previous year 
on any language domain 


Increase score on English 
language proficiency assessment 
at least one level from previous 
year or reach proficient on 
every language domain 


Increase overall composite score 
on English language proficiency 
assessment from previous year 


Alabama 






✓ 


Florida 




✓ 3 




Georgia 






✓ 


Mississippi 


✓ b 




✓ 


North Carolina 


✓ 






South Carolina 






✓ 



AMAO is annual measurable achievement objective. 

a. For domains that received both a scale score and a proficiency level (listening/speaking, reading, and writing). 

b. Students were also considered to have made progress if they increased their overall score on the English language proficiency assessment. Students 
already at the transitional level (the highest proficiency level) the previous year were required to maintain that level. 

Source: Authors' review of state AMAO policy documents. 
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for each state’s cohorts are in appendix E.) In How did each state define AMAO 2, and what 

Mississippi, all students were required to increase accountability determinations did each state report? 

their score by at least one level in a language 
domain or on the test as a whole; targets for the 
percentage of students expected to make prog- 
ress were set for the state and subgrantees at the 
cohort level. 

After determining how to group students for 
calculating AMAO 1 performance and defining 
student progress, states defined progress for the 
state and subgrantees and set annual targets. In all 
cases, the targets were the same for the state and 
subgrantees (table 6). Four states set a single target 
for the percentage of students served by Title III 
who were required to make progress toward profi- 
ciency for each subgrantee and the state, one state 
set separate targets for each language domain, and 
one set separate targets for the cohorts of students 
they had established. The percentage targets dif- 
fered across states. 

Reported accountability determinations. All states 
but Mississippi met their AMAO 1 targets, which 
differed across states (table 7). 



TABLE 6 

AMAO 1 state and subgrantee percentage threshold targets for progress toward proficiency, 2007/08 
(percent of students) 



State 


One target for 
all students 


Separate targets by 
language domain 


Separate targets by student cohort 


Alabama 


48.5 






Florida 




Listening/speaking: 70 
Writing: 54 
Reading: 56 




Georgia 


47.0 a 






Mississippi 11 






Two years in a language instruction program cohort: 68 
Three years or more in a language instruction program 
cohort: 80 


North Carolina 


60.0 






South Carolina 


20.0 







AMAO is annual measurable achievement objective. 

a. Georgia gave a "second look" to subgrantees that did not meet the AMAO target outright. If subgrantees had a higher percentage of students making 
progress than they did the previous year, they were considered to have made progress (Georgia Department of Education 2008c). In 2009, Georgia modified 
its AMAO 1 policy to remove this second-look provision (Georgia Department of Education 2009). 

b. AMAO 1 cohorts were not established for students in a language instruction program for just one year because two years of data were needed to calculate 
progress. 

Source: Authors' review of state AMAO policy documents. 



AMAO 1 reports on student progress toward full 
English proficiency; AMAO 2 reports on students 
reaching full proficiency. States and their Title III 
subgrantees must report annually whether they 
achieve their targets for growth in the number 
or percentage of students that attain full English 
proficiency (AMAO 2). Together, AMAOs 1 and 2 
provide accountability for increasing proficiency 
over time and reaching the “finish line” of fluency 
approximating that of a native English speaker. 

As in AMAO 1, differences across states — in how 
they grouped students for calculations, how they 
defined proficiency for students, whether they set 
single or multiple targets, the targets they set, and 
the ways they assessed English language profi- 
ciency — make comparison across states impos- 
sible. Therefore, this section simply reports the 
findings. 

State definitions. To define AMAO 2 in 2007/08, 
states first determined how to group students for 
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TABLE 7 

AMAO 1 accountability determinations, by state, 2007/08 





Students reported as 




Subgrantees meeting AMAO 1 


State 


making progress 
(percent) 


Did state 
meet AMAO 1? 


Number 


Percent 


Alabama 


55.4 


Yes 


44 


86 


Florida 


Listening/speaking: 79 
Writing: 63 
Reading: 67 


Yes 


43 


90 


Georgia 


64.1 


Yes 


78 


96 


Mississippi 3 


Not available 


No 


23 


100 


North Carolina 


84.1 


Yes 


85 


100 


South Carolina 


37.2 


Yes 


44 


100 



AMAO is annual measurable achievement objective. 

a. Mississippi established two cohort targets, but it did not report separate results. Seven subgrantees met AMAO 1 based on a cross-cohort index. The state 
considered any subgrantee with fewer than 40 English language learner students to have met AMAO 1 by default; 16 subgrantees fell into this category. See 
appendix E for details. 

Source: Authors' review of state federal reporting documents and AMAO subgrantee and determinations data. 



calculations (table 8). Georgia and South Caro- 
lina counted all ELL students in a single group. 
Alabama, Llorida, Mississippi, and North Carolina 
organized students into cohorts based on how 
long the students had been in language instruc- 
tion programs. (Llorida also grouped students by 
grade spans.) Three of the four states using cohorts 
established only one cohort (students with five 
or more years in Alabama and North Carolina, 



students with three or more years in Llorida). 3 
Mississippi grouped all students into cohorts for 
students with one year, two years, or three years 
or more of English language instruction. A single 
determination was then made across the three 
cohorts, using a “cross-cohort index.” 

States defined student proficiency based on cur- 
rent year English language proficiency assessment 



TABLE 8 

Methods of grouping English language learner students to calculate AMAO 2 performance, by state, 2007/08 



State 


All 

counted 

together 




Cohorts by years in a language instruction program 


One cohort: students 
with five years or more 


One cohort: 
students with three 
years or more 


Three cohorts: 

1 year 

2 years 

3 years or more 


Cohorts also organized 
by grade span (K-2, 
3-5,6-8,9-12) 


Alabama 




✓ 








Florida 






✓ 




✓ 


Georgia 


✓ 










Mississippi 








✓ 




North Carolina 3 




✓ b 








South Carolina 


✓ 











AMAO is annual measurable achievement objective. 

a. North Carolina's state policy included only students who had been served for five years or more "in U.S. schools"; other states' definitions of cohorts used 
the phrase "in a language instructional program." 

b. Credit was given for students attaining proficiency in less than five years. 

Source: Authors' review of state AMAO policy documents. 
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scores (table 9). Four states (Alabama, Georgia, 
Mississippi, and South Carolina) defined profi- 
ciency with an overall composite score; two states 
(Florida and North Carolina) required students 
to attain a minimum score on multiple language 
domains. 

After determining how to group students for 
calculating and defining proficiency, states set 
their annual targets for the percentage of students 
served by Title III that had to achieve proficiency 
for each subgrantee and the state to meet AMAO 
2. Three states set one target; three set multiple 
targets (table 10). Multiple targets were set for each 
subgrantee and for the state separately, by grade 
spans, or by the number of years students had 
been served in a language instruction program. 

Reported accountability determinations. All six 

states met their AMAO 2 target in 2007/08 (table 
11; for illustrations of how this determination was 
made, see box 4). 



How did each state define AMAO 3, and what 
accountability determinations did each state report? 

Whereas states have to define AMAOs 1 and 
2 “from scratch” for Title III accountability, 
AMAO 3 adopts the adequate yearly progress ac- 
countability measure from Title I. AMAOs 1 and 2 
relate specifically to English language proficiency 



and the English language proficiency assessment; 
adequate yearly progress is a measure of student 
academic achievement in content areas and is 
based on state content area academic assessments. 

AMAO 3 requires states to report whether the state 
and its subgrantees made adequate yearly progress 
for ELL students according to state-set targets 
required by Title I. States, districts, and schools 
receiving Title I funds must report annually on 
whether they meet the targets for all students and 
for each student subgroup. Subgroups are estab- 
lished for adequate yearly progress by ELL status, 
race/ethnicity, socioeconomic status (students 
eligible for free or reduced-price lunch), and spe- 
cial education status. States, districts, and schools 
are held accountable for achieving adequate yearly 
progress targets for subgroups that meet the state’s 
minimum size for generating valid statistical 
calculations (table 12). 

Each subgrantee (and the state) with access to 
Title III funds that met its state’s minimum ELL 
student subgroup size was responsible for report- 
ing adequate yearly progress for ELL students 
in 2007/08. Thus, although the adequate yearly 
progress targets reported here were not specific 
to the English language learner student subgroup 
(they applied to all students and to each sub- 
group under Title I), the AMAO 3 determinations 
reported here were the adequate yearly progress 



TABLE 9 

AMAO 2 definitions of English proficiency, by state, 2007/08 



State 


One score: 

reaching a certain proficiency level 
or overall composite score on English 
language proficiency assessment 


Multiple scores: 

reaching certain scores on all language domains 
of English language proficiency assessment 


Alabama 


✓ 




Florida 




✓ 


Georgia 


✓ 




Mississippi 


✓ 




North Carolina 




✓ 


South Carolina 


✓ 





AMAO is annual measurable achievement objective. 
Source: Authors' review of state AMAO policy documents. 
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TABLE 10 

AMAO 1 state and subgrantee percentage threshold targets for proficiency, 2007/08 (percent of students) 







Multiple targets 




State 


Single target Targets by state/subgrantee 


Target by grade 
span cohort 


Target by years student 
was served in language 
instruction program 


Alabama 


The state target was that 100 percent 
of English language learner students 
would attain proficiency in five years 
or less. 







Each subgrantee had its own target, set 
by taking as a baseline their percentage 
of the previous year. Each subgrantee 
was expected to increase performance 
annually, with goal of reaching 100 
percent by 2013/14. 



Florida 




K— 2: 23 
3-5:8 
6-8:7 
9-12:7 


Georgia 3 


5.0 




Mississippi 




1 year: 37 

2 years: 45 

3 years or more: 52 


North Carolina 


17.0 




South Carolina 


0.5 





AMAO is annual measurable achievement objective. 

a. Georgia also had a "second academic indicator" criterion for determining whether a district subgrantee met AMAO 2. Subgrantees that did not meet the 
target outright but whose performance was above the state average that year for the percentage of their students exiting English language learner services 
were classified as having met AMAO 2 (Georgia Department of Education 2008c). 

Source: Authors' review of state AMAO policy documents. 



TABLE 11 

AMAO 2 accountability determinations, by state, 2007/08 



State 


Students reported as 
reaching proficiency 
(percent) 


Did state meet 
AMAO 2? 


Subgrantees meeting AMAO 2 
Number Percent 


Alabama 


18 


Yes 


43 


84 


Florida 


K-2: 32 


Yes 


33 


69 




3-5: 19 










6-8:21 










9-12: 18 








Georgia 


13 


Yes 


73 


90 


Mississippi 


Not applicable 


Yes 


19 3 


83 


North Carolina 


19 


Yes 


38 


45 


South Carolina 


8 


Yes 


44 


100 



AMAO is annual measurable achievement objective. 

a. Three subgrantees met AMAO 2 based on the cross-cohort index (see box 4); 16 met it by default (based on having fewer than 40 English language learner 
students). See the Mississippi state profile in appendix E for details. 

Source: Authors' review of state federal reporting documents and AMAO subgrantee and determinations data. 
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BOX 4 

AMAO 2: Grouping students, 
defining proficiency, and setting 
targets 

Some examples can help connect 
the three steps states take to move 
from defining AMAO 2 to report- 
ing determinations. For instance, to 
be considered fluent in English in 
Florida, students with three or more 
years in an English language instruc- 
tion program were expected to reach 
the score of proficient on all English 
language proficiency assessment 
domains. The targets were set as the 
percentage of students in each grade 
level cohort with three or more years 
in an English language instruction 
program who must reach profi- 
ciency: 23 percent in K-2, 8 percent 
in grades 3-5, 7 percent in grades 
6-8, and 7 percent in grades 9-12. 

The state reported that the follow- 
ing percentages were achieved: 32 



percent in K-2, 19 percent in 3-5, 

21 percent in 6-8, and 18 percent in 
9-12, exceeding the target in each 
case. Hence, the state was reported 
as meeting AMAO 2. Florida also 
reported that 33 of its 48 subgrantees 
(69 percent) met their grade cohort 
targets for the percentage of students 
reaching proficiency, and so met 
AMAO 2. 

To be considered proficient in Missis- 
sippi, students had to reach a single 
score set according to the number 
of years in an English language 
instruction program: 37 percent for 
the one-year cohort, 45 percent for 
the two-year cohort, and 52 percent 
for the three-years-or-more cohort. 
Results were not separated by these 
cohorts, however. For each sub- 
grantee (and for the state), a single 
determination was made across the 
three cohorts, based on a “cross-co- 
hort index.” Just as for AMAO 1, sub- 
grantees made AMAO 2 either based 



on the cross-cohort index or by 
default (for subgrantees with fewer 
than 40 English language learner 
students). Hence, combining the 
3 subgrantees that made AMAO 2 
based on the cross-cohort index and 
the 16 that made it by default yields 
19 subgrantees that were reported as 
making AMAO 2. 

When all subgrantees’ student data 
were aggregated (so that the state- 
wide number of students exceeded 
the 40-student minimum), the 
state met the three cohort targets 
and so was reported as meeting 
AMAO 2 (K. Thompson, Director, 
Office of Research and Statistics, 
Mississippi Department of Educa- 
tion, personal communication, 

May 6, 2010; Y. Gilbert, Title III 
State Coordinator, Mississippi 
Department of Education, personal 
communication, May 6, 2010; Mis- 
sissippi Department of Education 
n.d.c). 



TABLE 12 

Minimum number of students in subgroup needed to trigger Title I adequate yearly progress reporting, by 
state, 2007/08 



State 


Minimum sample size of subgroup 


Alabama 


40 students. 


Florida 


30 students and more than 15 percent of school population, or 100 students regardless of percentage of 
school population. For example, a school in which 40 of 500 students were English language learner students 
would not meet the minimum sample size, because 40 is more than 30 but less than 15 percent of 500. A 
school with 100 English language learner students meets the minimum regardless of the school population. 


Georgia 


40 students or 10 percent of students enrolled in grades 3-8 and 11, whichever is greater, or 75 students 
regardless of percentage of school population in grades 3-8 and 11. For example, a school of 410 students 
has a subgroup minimum sample size of 41 (10 percent of 410). A school with 75 English language learner 
students meets the minimum regardless of the school population. 


Mississippi 


40 students. 


North Carolina 


40 students or 1 percent of students tested, whichever is greater. 


South Carolina 


40 students. 



Source: Authors' review of state federal reporting documents. 
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determinations for the ELL subgroup in states 
and their district subgrantees that received Title 
III funds. 

AMAO 3 definitions differed by state. The states 
differed in the minimum subgroup size required 
for calculating an adequate yearly progress sub- 
group calculation (see table 12). They differed in 
their academic content area assessments and (in 
high school) in the grades and courses included in 
calculations (table 13). States also set different tar- 
gets, so common interpretations or comparisons 
cannot be made across states. 

State definitions. Adequate yearly progress targets 
comprise student participation rates in state aca- 
demic assessments, student academic achievement 
targets, and “second academic indicators” (No 
Child Left Behind 2002e). 4 These components and 
their associated targets apply to all students and 
subgroups, including ELL students. 

for student participation rate, the target is set by 
NCLB legislation. All states require that 95 percent 
or more of their students participate in at least the 
reading/language arts and math state academic 
assessments to meet the target. 5 

for student achievement, states must establish 
measures of progress and annual targets toward 
having all students proficient in at least reading/ 
language arts and math by 2013/14. Adequate 



yearly progress determinations must be reported 
for grades 3-8 and one grade in high school. 

Second academic indicators, required by Title I 
as the third measure of success, are typically the 
attendance rate for elementary and middle schools 
and the graduation rate for high schools. See ap- 
pendix E for details on each state’s second aca- 
demic indicators, targets, and reported results. 

Reported accountability determinations. Only two 
states — Alabama and Mississippi — met AMAO 3 
(table 14). Determination of progress toward 
AMAO 3 is made in the following way, taking 
North Carolina as an example. In North Carolina, 
96 districts had access to Title III funds — 84 with 
enough ELL students to trigger an adequate yearly 
progress subgroup determination. These districts 
had to meet the state’s adequate yearly progress 
targets for ELL student subgroup participation in 
content area assessments, academic achievement, 
and second academic indicators. To meet AMAO 
3 in reading/language arts, 43.2 percent of ELL 
grade 3-8 students in the 84 districts had to show 
proficiency on the end-of-course assessment, and 
38.5 percent of high school students had to show 
proficiency on the English I and writing assess- 
ments; in math, 77.2 percent of ELL students in 
the 84 districts had to show proficiency on the 
end of grade assessment in grades 3-8, and 68.4 
percent had to show proficiency on the high school 
math assessment. North Carolina reported that 



TABLE 13 

Assessments used to measure progress toward Title I adequate yearly progress targets, by state, 2007/08 



State 


Grades 3-8 a 


FHigh school 


Alabama 


Alabama Reading and Mathematics Test 


Grade 11: Alabama FHigh School Graduation Exam 


Florida 


Florida Comprehensive Assessment Test 


Grades 9-10: Florida Comprehensive Assessment Test 


Georgia 


Criterion-Referenced Competency Test 


Grade 11: Georgia FHigh School Graduation Test 


Mississippi 


Mississippi Curriculum Test 


End-of-course assessments in algebra and English II 


North Carolina 


End-of-grade assessments 


Grade 10: math (Algebra 1 end-of-course assessment) 
English 1: end-of-course assessments 
Grade 10: writing assessment 


South Carolina 


Palmetto Achievement Challenge Test 


Grades 9-12: FHigh School Assessment Program 



a. States used an alternate assessment for students with severe cognitive disabilities. 
Source: Authors' review of state federal reporting documents. 
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TABLE 14 

AMAO 3 accountability determinations, by state, 2007/08 







Districts with enough English language learner 
students to generate a Title 1 adequate yearly 
progress subgroup determination 


Number of districts 
without enough English 
language learner students 


State 


Did state meet 
AMAO 3? 


Number meeting 
AMAO 3 


Percent meeting 
AMAO 3 


to generate a Title 1 
adequate yearly progress 
subgroup determination 


Alabama 


Yes 


32 


100 


21 


Florida 


No 


0 


0 


0 


Georgia 


No 


46 


92 


113 


Mississippi 


Yes 


23 a 


100 a 


a 


North Carolina 


No 


7 


8 


12 


South Carolina 


No 


26 


68 


29 



AMAO is annual measurable achievement objective. 

a. See explanation of determinations reporting for Mississippi in appendix E. 

Source: Authors' review of state federal reporting documents and AMAO subgrantee and determinations data. 



7 of the 84 districts (8 percent) met these targets. 
Twelve districts did not have enough ELL students 
to require an adequate yearly progress subgroup 
determination, so no AMAO 3 determination was 
reported. 



STUDY LIMITATIONS 

This report has several limitations. Because of 
the many variations in state definitions of the 
AMAOs, both targets and results reported have 
different meanings in each state, making com- 
parisons across states impossible. The report 
therefore simply describes the various states’ 
performance. 

The report describes AMAOs in just six states 
for one year — a snapshot that may not reflect the 
situation in other states or in these states in other 
years. The report does not provide context on the 
AMAOs (for example, on how or why the states 
crafted their policies) or address the merits of 
AMAO policies. Some state AMAO policies have 
changed since data collection. Changes known to 



the authors are noted in endnotes and table notes, 
further changes might not be reflected. 

further research could explore how and why states 
define their AMAOs as they do. Second, it could 
examine trends in state AMAO definitions and de- 
terminations across multiple years. Such descrip- 
tive information could increase understanding of 
how states build and implement accountability 
amid the varying practical complexities of ELL 
student education and accountability — com- 
plexities that include differences in ELL student 
demographics, such as location, first language, 
and concentrations, and diverse policy contexts 
(diverse state parameters for program funding and 
language instruction program models, different 
human resource and capacity issues, and other in- 
tersecting state policy issues). Such research could 
also increase knowledge of state practices in ELL 
student accountability that could inform national 
policy endeavors (for example, the Common Core 
Standards Initiative and the next reauthorization 
of the Elementary and Secondary Education Act; 
American Institutes for Research 2010a; Working 
Group on ELL Policy 2010). 
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APPENDIX A 

DATA SOURCES AND METHODOLOGY 

Study data were organized using a data organi- 
zation protocol (see appendix B) and collected 
for school year 2007/08, the most recent year for 
which data on both annual measurable achieve- 
ment objectives (AMAO) policies and reported 
determinations were available for all six Southeast 
Region states at the time of data collection. 



Constructing the data organization protocol 

Researchers first identified — on state education 
agency websites, the U.S. Department of Edu- 
cation website, and other sites — the informa- 
tion sources for the states’ AMAO policies and 
accountability determinations. These sources 
included Title III AMAO policies, descriptions of 
English language proficiency assessments, lists 
of Title III subgrantees, adequate yearly prog- 
ress workbooks, consolidated state performance 
reports, and Title III AMAO determinations 
data. Reviewing these documents revealed com- 
mon elements in the structure and content of the 
AMAO policies and determinations reporting. 
All the documents indicated the numbers and 
types of Title III subgrantees in the state, the 
English language proficiency assessments used, 
how students were grouped for calculations, 
the parameters used to define each AMAO, the 
annual targets, and the reported determinations 
for subgrantees and the states. The protocol 
was developed to systematically organize this 
information for each state from the resource 
documents. 

Changes to states’ AMAO policies (such as a 
change in the English language proficiency assess- 
ment used) since 2007/08 were also recorded, 
though an exhaustive search for policy changes 
was not conducted. Changes were noted in the ap- 
plicable sections of the protocol (and are reported 
as notes in the findings section and in table notes) 
to reinforce that this study examined information 
for only one school year. 



Collecting the data 

After the source documents were gathered, emails 
were sent to state Title III directors to confirm that 
all the correct and relevant documents for their 
state had been collected. Where information was 
not available through online searches, Title III 
directors were asked to provide it. These state staff 
were informed about the study’s purpose and how 
the data were to be used. 

The principal investigator and the second re- 
searcher independently completed a draft protocol 
for one state; it was then reviewed and discussed. 
Discrepancies were resolved by referring back 
to the original state documents and agreeing on 
the source, information, and level of detail. The 
protocol was adjusted as necessary to capture 
information on all elements. The process was then 
repeated for the other five states. Where questions 
or discrepancies could not be resolved by consult- 
ing the source documents (for example, when 
two source documents for a state had different 
information on the same element), state Title III 
directors were contacted for clarification. Their 
responses were incorporated into each state’s 
protocol. Through this process, consensus was 
reached for all elements in each protocol. 



Analyzing the data 

The finalized protocol for one state was used to 
develop a narrative profile describing the infor- 
mation corresponding to each research question. 
After the narrative was discussed, a third reviewer 
read it against the information in the state proto- 
col, flagging questions or noting where clarifica- 
tion was needed. The profile was revised based on 
these reviews. Using this profile as a model, the re- 
searchers divided the rest of the states and drafted 
their profiles. All the drafts were then reviewed 
collaboratively by the two researchers and revised 
as necessary. 

The principal investigator reviewed the profiles 
and drafted descriptive statements and tables 
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showing the information that relates to each re- 
search question. These draft statements and tables 
were discussed, and questions were answered by 
consulting the state profiles. A third reviewer read 
the draft statements and tables, asking questions 
and making suggestions for clarity. The findings 
were then finalized. 



Once the state profiles were prepared, they were 
sent to the state’s Title III director, who reviewed 
the information and provided feedback. After re- 
ceiving feedback from all six states, any necessary 
changes were incorporated. 
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APPENDIX B AMAO 1 progress definition 

DATA ORGANIZATION PROTOCOL 

Element 1: How students are counted in calculations 

The following information was gathered for each 

Southeast Region state. 1. Grouped together 



Numbers and types of Title III subgrantees 

Element 1: How Title III subgrantees are defined in 
the state and the number 

1. Local education agencies, number of local 
education agency subgrantees 

2. Consortia, composition of consortia, number 
of consortia subgrantees 

3. Number of subgrantees in state 
English language proficiency assessment 

Element 1: English language proficiency assessment 

1. Name of assessment 

2. Developer of assessment and website URL 

Element 2: Assessment grade span tests, tiers, and 
language domains tested 

1. Tiers, explanation of tiers 

2. Grade spans 

3. Language domains tested 

Element 3: Student scores reported 

1. Domains 

2. Composite or overall/total score, explanation 
of how score was calculated 

3. Proficiency levels 



2. Placed in cohorts 

a. By number of years receiving English 
language instruction services 

b. By performance band 

c. By grade span 

d. Other 

Element 2: How progress toward English proficiency 
is defined for students 

1. Single score on assessment 

a. Score on any one domain 

b. Composite score or overall/total score 

2. Multiple scores 

Element 3: How progress is measured for the state 
and subgrantees 

1. Single target percentage of students increasing 
proficiency level 

2. Multiple targets (for example, by language 
domain score or cohort) 

3. Additional criteria (for example, “second 
look” in Georgia) 

Element 4: AMAO 1 percentage targets 



AMAO 2 proficiency definition 

Element 1: How students are counted in 
calculations 

1. Grouped together 

2. Place in cohorts 

a. By number of years receiving English 
language instruction services 

b. By performance band 
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c. By grade span 

d. Other 

Element 2: How reaching proficiency in English is 
defined for students 

1. Single score on assessment 

a. Score on any one domain 

b. Composite or overall/total score 

2. Multiple scores 

Element 3: How reaching proficiency in English is 
defined for the state and subgrantees 

1. Single percentage of students reaching 
proficiency 

2. Multiple targets (for example, subgrantee, 
grade levels, years receiving Title III services) 

3. Other criteria (for example, “second indicator” 
in Georgia) 

Element 4: AMAO 2 percentage targets 

AMAO 3 Adequate yearly progress definition 

Element 1: Minimum number of students re- 
quired to calculate English language learner (ELL) 
subgroup 

1. Minimum sample size 

2. Additional criteria (for example, percentage of 
total enrollment) 

Element 2: Assessments used, grades, and courses 
with Title I adequate yearly progress targets 

Element 3: Adequate yearly progress targets 

1. Participation 



2. Achievement for reading/language arts and 
math 

3. Second academic indicators 



AMAO 1 reported determinations 

1. Percentage of students that made progress or 
description of other outcome (for example, 
Mississippi’s cross-cohort index) 

2. Did state meet AMAO 1? Yes/No 

3. Number of subgrantees meeting AMAO 1 

4. Percentage of subgrantees meeting AMAO 1 



AMAO 2 reported determinations 

1. Percentage of students that reached profi- 
ciency or description of other outcome (for 
example, Mississippi’s cross-cohort index) 

2. Did state meet AMAO 2? Yes/No 

3. Number of subgrantees meeting AMAO 2 

4. Percentage of subgrantees meeting AMAO 2 



AMAO 3 reported determinations 

1. Did state meet AMAO 3? Yes/No 

2. Number and percentage of districts with enough 
ELL students to generate an adequate yearly 
progress determination that met AMAO 3 

3. Number of districts with access to Title 
III funds without enough ELL students to 
generate a Title I adequate yearly progress 
determination 

4. Other notes 
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APPENDIX C 

U.S. DEPARTMENT OF EDUCATION 2008 
REVISED INTERPRETATIONS OF TITLE III OF 
THE NO CHILD LEFT BEHIND ACT OF 2001 

In October 2008, the U.S. Department of Educa- 
tion revised its interpretations of No Child Left 
Behind Title III, making the following changes 
(National Clearinghouse for English Language 
Acquisition 2009a): 

• States must annually assess all English 
language learner (ELL) students for English 
proficiency in the language domains of speak- 
ing, listening, reading, and writing. (Scores on 
domains may not be “banked” from one year 
to the next.) 

• States have some flexibility in how they 
structure the English language proficiency as- 
sessments. Assessments may provide separate 
scores in each language domain, a single com- 
posite score, or both, as long as the assessment 
is valid and reliable for meaningfully assess- 
ing student progress and proficiency. 

• States must include all ELL students served 
by Title III in Title III accountability. The only 
exceptions are ELL students who have not 
participated in two administrations of the 
states’ annual English language proficiency 
assessment (annual measurable achievement 
objective [AMAO] 1) and ELL students ex- 
cluded from adequate yearly progress deter- 
minations under normal Title I rules (AMAO 
3). 

• States have flexibility in determining prog- 
ress in English proficiency. At a minimum, 
AMAO 1 must include all ELL students served 
by Title III with two measures on the state’s 
annual English language proficiency assess- 
ment. If a student does not have two measures 
from which to determine progress, the state 



may propose an alternative, valid, and reliable 
method for calculating progress. 

• States have flexibility in defining English 
proficiency for accountability under Title III 
but are strongly encouraged to use the same 
definition they use to exit students from the 
ELL student subgroup under Title I. 

• States may use a minimum subgroup size for 
Title III accountability (the minimum number 
of ELL students served needed to trigger the 
reporting requirement), but it must be the 
same as that approved under Title I. (States 
may apply minimum sample size to the ELL 
student subgroup in general, not to separate 
cohorts of ELL students established in AMAO 
policies.) 

• States may use the adequate yearly progress 
determination for the ELL student sub- 
group under Title I for Title III AMAO 3 
accountability. 

• States may establish separate AMAO targets 
for ELL student cohorts, based on how long 
(for example, number of years) the students 
have had access to Title III language instruc- 
tion services. 

• States have flexibility in making account- 
ability determinations for Title III consortia. 
States can decide whether to treat consor- 
tia that consist of more than one district 

as a single entity or as separate entities for 
accountability. 

• States must implement corrective actions 
as required under Title III for every district 
for every year. States must annually inform 
their districts when they do not meet AMAO 
targets, communicate this information to par- 
ents of ELL students, and implement required 
technical assistance and consequences. 
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APPENDIX D 

ENROLLMENT OF ENGLISH LANGUAGE 
LEARNER STUDENTS AND FIRST LANGUAGE 



TABLE D1 

Enrollment of English language learner students and students receiving Title III services, by state, 2007/08 





English language learner students 




Number of Title III 


State 


Number enrolled 
in K-12 


Percentage of 
total enrollment 


Percentage growth 
in K-12 enrollment, 
1995/96-2005/06 


Number of 
students receiving 
Title III services 


students taking 
state English 
language proficiency 
assessment 


Alabama 


19,508 


3 


263 


16,816 


16,816 


Florida 


268,207 


10 


60 


161,445 


117,771 


Georgia 


79,894 


5 


252 


65,815 


60,129 


Mississippi 


5,428 


1 


73 


4,664 


2,683 


North Carolina 


114,620 


8 


346 


113,011 


101,713 


South Carolina 


29,907 


4 


688 


27,244 


28,129 



Source: National Clearinghouse for English Language Acquisition 2009b; American Institutes for Research 2010b; authors' analysis of state federal reporting 
documents. 



TABLE D2 

Languages most commonly spoken by K-12 English language learner students, by state, 2007/08 



1 State 


Languages 


Alabama 


Spanish, Korean, Arabic, Vietnamese, Russian 


Florida 


Spanish, FHaitian Creole, Portuguese, Vietnamese, Arabic, Chinese, French 


Georgia 


Spanish, Vietnamese, Korean, other African languages, Chinese 


Mississippi 


Spanish, Vietnamese, Arabic, Cantonese, Chinese 


North Carolina 


Spanish, Hmong, Vietnamese, Arabic (Egyptian), Korean 


South Carolina 


Spanish, Russian, Vietnamese, Portuguese, Arabic 



Note: Languages are in order of number of speakers. 

Source: Authors' analysis of state federal reporting documents. 
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APPENDIX E 
STATE PROFILES 

This appendix provides detailed information on 
English language learner (ELL) students as well 
as state and subgrantee progress toward meeting 
the annual measurable achievement objectives 
(AMAO) in each state. All tables refer to public 
school students in grades K-12. 



Title Ill-funded districts: sheltered instruction, 
sheltered immersion, content-based English as a 
second language, and pull-out English as a second 
language (Alabama State Department of Education 
2008b; see appendix F). 

Numbers and types of Title III subgrantees. Ala- 
bama reported 51 Title III subgrantees in 2007/08, 
including 2 consortia (table E2). 



Alabama 

Alabama has seen rapid growth in its K-12 ELL 
student population in recent years, registering 
a 263 percent increase over 1995/96-2005/06 
(National Clearinghouse for English Language 
Acquisition 2009b). By 2007/08, 3 percent of all 
students in Alabama public schools were identified 
as ELL students (table El). 



The five most commonly spoken languages by 
Alabama’s ELL students in 2007/08 were (in order) 
Spanish, Korean, Arabic, Vietnamese, and Rus- 
sian (Alabama State Department of Education 
2008b). Alabama reported using three language 
instructional models to serve these students in 



TABLE El 

English language learner students and students 
receiving Title III services in Alabama, 2007/08 



Number of 


Percentage of 
total enrollment 


Number of 


English language 


identified as 


students 


learner students 


English language 


receiving Title 


enrolled in K-12 


learner students 


III services 


19,508 


3 


16,816 



Source: American Institutes for Research 2010b; Alabama State Depart- 
ment of Education 2008b. 



English language proficiency assessment used. 

Alabama had used Assessing Comprehension and 
Communication in English State-to- State for Eng- 
lish Language Learners (ACCESS for ELLs) to as- 
sess English proficiency since 2005 (Alabama State 
Department of Education n.d.b), administering the 
assessment to 16,816 students in 2007/08 (table E3). 

Table E4 provides information on the student 
scores provided by ACCESS for ELLs. 

AMAO 1. Alabama’s definition for AMAO 1 
grouped students for calculations based on their 



TABLE E3 

Grade spans, tiers, and language domains 
assessed by ACCESS for ELLs in Alabama, 2007/08 





Tiers 


Language domains 
assessed 


Pre-K-K, 


A: Beginning 


Listening, speaking, 


1-2, 3-5, 


B: Intermediate 


reading, writing 


6-8, 9-12 


proficiency 






C: Advanced 






proficiency 





ACCESS for ELLs is Assessing Comprehension and Communication in 
English State-to-State for English Language Learners. 

Note: Tiers apply to each grade span of the test. 

Source: WIDA Consortium n.d., 2009b. 



TABLE E2 

Title III subgrantees in Alabama, 2007/08 (number, unless otherwise noted) 



Title III 
subgrantees 


District 

subgrantees 


Consortium 

subgrantees 


Districts 
represented 
within the 
consortia 


Districts with 
access to Title 
III funding 


Total districts 


Districts with 
access to Title 
III funding 
(percent) 


51 


49 


2 


4 


53 


131 


40 



Source: Alabama State Department of Education n.d.d, 2008b. 
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TABLE E4 

Types of scores generated by ACCESS for ELLs in Alabama, 2007/08 



Language domain scores 


Composite scores 


Proficiency level scores 


Listening, speaking, reading, writing 


Oral language (listening/speaking), 


1: Entering 




literacy (reading/writing), 


2: Beginning 




comprehension (listening/reading), 


3: Developing 




overall 


4: Expanding 






5: Bridging 






6: Reaching 



ACCESS for ELLs is Assessing Comprehension and Communication in English State-to-State for English Language Learners. 
Source: WIDA Consortium n.d., 2009b. 



previous year’s ACCESS for ELLs score. These 
proficiency cohorts were organized in score spans, 
defined as successive ranges on the overall com- 
posite score (ALSDE n.d.b; table E5). 

Students were considered to have made progress if 
they met Alabama’s adequate progress in lan- 
guage acquisition targets (Alabama State Depart- 
ment of Education n.d.b). These targets required 
that students meet the established minimum 
gain in their overall ACCESS for ELLs composite 
score from one year to the next, based on their 
proficiency cohort and grade level. For example, 
in 2006/07 a grade 3 student who received a 2.2 
overall composite score on the ACCESS for ELLs 
(proficiency cohort 2) would have needed to score 
at least 3.0 (2.2 plus the required minimum gain 



TABLE E5 

Proficiency cohorts for AMAO 1 calculations in 
Alabama, 2007/08 



Proficiency cohort 


ACCESS for ELLs overall 
composite score span 


1 


1. 2-2.0 


2 


2. 1-2. 8 


3 


2.9-3. 5 


4 


3.6-4.1 


5 


4.2-47 


6 


4.8-5. 3 


7 


5.4-6.0 



AMAO is annual measurable achievement objective. ACCESS for ELLs is 
Assessing Comprehension and Communication in English State-to-State 
for English Language Learners. 

Source: Alabama State Department of Education n.d.b. 



of 0.8) to meet the targets for 2007/08 (table E6). 
In 2007/08, subgrantees and the state had to meet 
the same single percentage target of students 
served by Title III to meet AMAO 1 (G. dejong, 
Administrator, Federal Programs, Alabama 



TABLE E6 

Definitions of student progress toward AMAO 1 in 
Alabama, 2007/08 



Grade 

span 


Proficiency 
cohort in 
2006/07 


Minimum gain in ACCESS 
for ELLs overall composite 
score required to make 
adequate progress in 
language acquisition 


K-2 


1-2 


1.0 




3 


0.8 




4 


0.6 




5 


0.4 


3-5 


1-2 


0.8 




3 


0.6 




4 


0.4 




5 


0.2 


6-8 


1-2 


0.6 




3 


0.4 




4 


0.3 




5 


0.2 


9-12 


1-2 


0.5 




3 


0.4 




4 


0.3 




5 


0.2 



AMAO is annual measurable achievement objective; ACCESS for ELLs is 
Assessing Comprehension and Communication in English State-to-State 
for English Language Learners. 

Source: Alabama State Department of Education n.d.b. 
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TABLE E7 

AMAO 1 target and determinations in Alabama, 2007/08 



Students making progress (percent) 


Did state meet 


Subgrantees meeting AMAO 1 


Target 


Actual 


AMAO 1? 


Number 


Percent 


48.5 


55.4 


Yes 


44 


86 



AMAO is annual measurable achievement objective. 
Source: Alabama State Department of Education 2008a. 



TABLE E8 

AMAO 2 targets and determinations in Alabama, 2007/08 



Target for students with five or more years 


Subgrantees meeting AMAO 2 


Did state meet 


in a language instruction program 


Number 


Percent 


AMAO 2? 


Subgrantee 

Each subgrantee had its own target, set by taking as 
a baseline the percentage of students that achieved 
proficiency the previous year. Each subgrantee was 
expected to increase the percentage of students reaching 
proficiency annually toward 100 percent by 2014. (No 
guidelines on the required increase were published.) 


43 


84 


na 


State 

All English language learner students attain proficiency in 
five years or less. 


na 


na 


Yes 



na is not applicable; AMAO is annual measurable achievement objective. 
Source: Cook et al. 2008; Alabama State Department of Education 2008a. 



Department of Education, personal communica- 
tion, August 10, 2009). 

Alabama met AMAO 1 in 2007/08, with 55.4 per- 
cent of students making progress (table E7). 

AMAO 2. Alabama’s definition of AMAO 2 in 
2007/08 grouped students into cohorts by the 
number of years they had been served in a lan- 
guage instruction program and included only 
the cohort with five or more years of instruction 
(Alabama State Department of Education n.d.b). 6 
Students were considered proficient when they 
received an ACCESS for ELLs overall composite 
score of 4.8 or higher on the tier B or tier C exam 
(Alabama State Department of Education). Indi- 
vidual subgrantees and the state each had to meet 



its own target of students reaching proficiency. 
Alabama and 84 percent of its subgrantees met 
AMAO 2 in 2007/08 (table E8). 

AMAO 3. To trigger the need for an AMAO 3 
determination, schools in Alabama had to have at 
least 40 ELL students (Alabama State Department 
of Education 2008a). 

Alabama used two main instruments to measure 
student progress (table E10). 

Both Alabama and its districts with access to 
Title III funds that had enough ELL students 
to generate a Title I adequate yearly progress 
subgroup determination met AMAO 3 in 2007/08 
(table E13). 
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TABLE E9 

Target and reported participation rates on Title 
I adequate yearly progress tests in Alabama, 
2007/08 (percent) 



Target 


Reported 


95 


99 



Source: Alabama State Department of Education n.d.c. 



TABLE E10 



Assessments used to measure Title 1 adequate 
yearly progress in Alabama, 2007/08 


Grade span 


Assessment 


3-8 a 


Alabama reading and mathematics test 


High school 


Grade 11: Alabama high school 
graduation exam 



a. An alternate assessment was used for students with severe cognitive 
disabilities. 

Source: Alabama State Department of Education 2008b. 



TABLE Ell 

Targets and reported results for Title I adequate yearly progress in reading/language arts and math in 
Alabama, 2007/08 (percent proficient or advanced) 







Reading/language arts 




Math 




Grade 


Target 


Reported 


Target 




Reported 


3 


77 


71.3 


68 




65.0 


4 


77 


69.9 


72 




64.3 


5 


77 


63.7 


65 




58.5 


6 


81 


66.7 


56 




49.8 


7 


68 


43.5 


49 




35.7 


8 


59 


41.0 


55 




49.3 


11 


86 


84.1 


77 




75.4 



Source: Alabama State Department of Education n.d.a, 2008b. 



TABLE E12 

Second academic indicators of adequate yearly progress in Alabama, 2007/08 (percent) 



Grade level 


Indicator 


Target 


Reported 


Elementary and middle school 


Attendance 


95 


97 


High schools 


Graduation rate 


90 


83 






or 

Improvement toward target 





Source: Alabama State Department of Education n.d.a. 



TABLE E13 

AMAO 3 accountability determinations in Alabama, 2007/08 





Districts with access to Title III funding with enough 
English language learner students to generate a Title 
1 adequate yearly progress subgroup determination 


Number of districts with access to 
Title III funding without enough 
English language learner students 


Number of 


Did state 






to generate a Title 1 adequate yearly 


districts with 


meet 


Number meeting 


Percent meeting 


progress subgroup determination (no 


access to Title 


AMAO 3? 


AMAO 3 


AMAO 3 


AMAO 3 determination reported) 


III funding 


Yes 


32 


100 


21 


53 



AMA0 is annual measurable achievement objective. 

Source: Alabama State Department of Education n.d.d, 2008a. 
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Florida 

Florida has long been a state with one of the 
highest numbers of ELL students (National 
Clearinghouse for English Language Acquisi- 
tion 2009b). Over 1995/96-2005/06, the number 
of ELL students in K-12 public schools rose 60 
percent (National Clearinghouse for English 
Language Acquisition 2009b). In 2007/08, 10 
percent of all students enrolled in Florida public 
schools were enrolled in ELL programs (table 
E14). 

The seven languages most commonly spoken by 
Florida’s ELL students in 2007/08 were (in order) 
Spanish (by far the most common), Haitian Creole, 
Portuguese, Vietnamese, Arabic, Chinese, and 
French (Florida Department of Education 2008a). 
The state reported using six language instruction 
models to serve these students in Title Ill-funded 
districts: sheltered English, sheltered core/basic 
subject areas, mainstream/inclusion (English), 
mainstream/inclusion (core/basic subject areas), 
one-way developmental bilingual education, and 
dual language (Florida Department of Education 
2008a; see appendix F). 



TABLE E14 

English language learner students and students 
receiving Title III services in Florida, 2007/08 



Number of 


Percentage of 
total enrollment 


Number of 


English language 


identified as 


students 


learner students 


English language 


receiving Title 


enrolled in K-12 


learner students 


III services 


268,207 


10 


161,445 



Source: Florida Department of Education 2008a; American Institutes for 
Research 2010b. 



Numbers and types of Title III subgrantees. In 

2007/08, Florida reported having 48 Title III sub- 
grantees (table E15). 

English language proficiency assessment used. To 

assess English proficiency for ELL students in 
2007/08, Florida used the Comprehensive Eng- 
lish Language Learning Assessment (CELLA), 
developed by a consortium of five states (Florida, 
Maryland, Michigan, Pennsylvania, and Tennes- 
see), Accountability Works, and the Educational 
Testing Service (Florida Department of Education 
n.d.c). Florida had used this assessment since 
2006. In 2007/08, 117,771 students were admin- 
istered the assessment. Table E16 provides basic 
information on the format of the assessment and 
language domains assessed. 

Table E17 provides information on the student 
scores provided by the CELLA. 

AMAO 1. Florida’s 2007/08 AMAO 1 definition 
grouped all ELL students together for calcula- 
tions (Florida Department of Education n.d.c). 
Students were considered to have made progress 
if they increased their proficiency level or reached 
proficiency in all three CELLA domains (listen- 
ing/speaking, writing, and reading; Florida 

TABLE E16 

Grade spans and language domains assessed by 
the Comprehensive English Language Learning 
Assessment in Florida, 2007/08 



Grade spans 


Language domains assessed 


K-2,3-5,6-8, 9-12 


Listening, speaking, 




reading, writing 



Source: Florida Department of Education n.d.b. 



TABLE E15 

Title III subgrantees in Florida, 2007/08 (number, unless otherwise noted) 



Title III 
subgrantees 


District 

subgrantees 


Consortium 

subgrantees 


Districts with 
access to Title 
III funding 


Total districts 


Districts with 
access to Title III 
funding (percent) 


48 


48 


0 


48 


67 


72 



Source: Florida Department of Education 2008a, c,d,e. 
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TABLE E17 

Types of scores generated by the Comprehensive English Language Learning Assessment in Florida, 2007/08 



Language domain scores 


Composite scores 


Proficiency level scores 


Listening, speaking, reading, writing 


Oral language 


1: Beginner 




(listening/speaking), 3 total 


2: Low intermediate 






3: High intermediate 






4: Proficient 



a. Students receive separate raw scores for listening and speaking. The scores are then combined for a listening/speaking scale score and proficiency level. 
The listening/speaking, reading, and writing skill areas receiving both scale scores and proficiency levels are the "domains" used for Florida's AMAO 1 and 
AMAO 2 targets. 

Source: Florida Department of Education n.d.b. 



Department of Education n.d.c). Progress for sub- 
grantees and the state required meeting a target 
for the percentage of all students making progress 
in each of the three language domains (table E18). 

AMAO 2. Florida’s 2007/08 AMAO 2 definition 
grouped students into cohorts by the number of 
years they had been served in a language instruc- 
tion program and included only the cohorts of 
students with more than three years’ instruction. 7 
Florida grouped these students into grade-level 



cohorts (K-2, 3-5, 6-8, and 9-12). Students 
were considered proficient when they received a 
proficient scale score and proficiency level on the 
CELLA in listening/speaking, writing, and read- 
ing (Florida Department of Education n.d.c). The 
state and subgrantees had to meet targets for each 
grade-level cohort (table E19). 

AMAO 3. To trigger the need for an AMAO 3 
determination, Florida schools had to have at least 
30 ELL students or enough students to account 



TABLE E18 

AMAO 1 targets and determinations in Florida, 2007/08 



Students making progress (percent) t t meet Title III subgrantees meeting AMAO 1 



Domain 


Target 


Actual 


AMAO 1? 


Number 


Percent 


Listening/speaking 


70 


79 








Writing 


54 


63 


Yes 


43 


90 


Reading 


56 


67 









AMAO is annual measurable achievement objective. 
Source: Florida Department of Education 2008a, c. 



TABLE E19 

AMAO 2 targets and determinations in Florida, 2007/08 



Grade span 



Students with more than three years in a language 
instruction program reaching proficiency (percent) 

Target Actual 



K-2 


23 


32 


3-5 


8 


19 


6-8 


7 


21 


9-12 


7 


18 



Did state meet 
AMAO 2? 



Yes 



Subgrantees 
meeting AMAO 2 

Number Percent 



33 



69 



AMAO is annual measurable achievement objective. 
Source: Florida Department of Education n.d.c, 2008a, d. 
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for at least 15 percent of the school population; 
schools with at least 100 ELL students had to show 
progress on AMAO 3 regardless of the size of the 
school. Thus, a school of 500 students with 40 
ELL students would not meet the minimum size, 
because the number of ELL students is less than 
15 percent of the total. A school of 3,000 students 
with 100 ELL students would meet the minimum, 
even though the proportion of students is less 
than 15 percent (Llorida Department of Education 
2008b). Llorida reported 98 percent of students 
participating in both the reading and math tests 
(table E20). 

TABLE E20 

Target and reported participation rates on Title I 
adequate yearly progress tests in Florida, 2007/08 
(percent) 



Target 


Reported 


95 


Reading: 98 


Math: 98 



Source: Florida Department of Education n.d.a. 



Llorida used a single instrument, the Llorida 
Comprehensive Assessment Test, to assess student 
progress (table E21). 

The state’s student achievement targets were set 
for the percentages of students reaching proficient 
or advanced levels in reading/language arts and 
math (table E22). 

Llorida did not meet the AMAO 3 accountability 
determination (table E24). 



TABLE E21 

Assessment used to measure Title I adequate 
yearly progress in Florida, 2007/08 



1 Grade span 


Assessment 


3-8 a 


Florida Comprehensive Assessment Test 


9-10 


Florida Comprehensive Assessment Test 



a. An alternate assessment was used for students with severe cognitive 
disabilities. 

Source: Florida Department of Education 2008b. 



TABLE E22 

Targets and reported results for Title I adequate yearly progress in reading/language arts and math in 
Florida, 2007/08 (percent proficient or advanced) 



Reading/language arts 




Math 




Grade span Target Reported 


Target 




Reported 


3-8 and 9-10 58 37 


62 




47 


Source: Florida Department of Education n.d.a, 2008b. 



TABLE E23 

Second academic indicators of adequate yearly progress in Florida, 2007/08 


Grade level 


Indicator 


Target 


Reported (percent) 


Grades 
4, 8, and 10 


Florida Writes 
assessment 


More than 90 percent of students attain 
proficient score of 3.0 
or 

If less than 90 percent, results improve by at 
least 1 percentage point from previous year 


81 


FHigh school 


Graduation rate 


More than 85 percent 
or 

If less than 85 percent, results improve by at 
least 1 percentage point from previous year 


48 



Source: Florida Department of Education n.d.a. 
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TABLE E24 

AMAO 3 accountability determinations in Florida, 2007/08 





Districts with access to Title III funding with enough 
English language learner students to generate a 
Title 1 adequate yearly subgroup determination 


Number of districts with access to 
Title III funding without enough 
English language learner students 


Number of 


Did state 






to generate a Title 1 adequate yearly 


districts with 


meet 


Number meeting 


Percent meeting 


progress subgroup determination (no 


access to Title 


AMAO 3? 


AMAO 3 


AMAO 3 


AMAO 3 determination reported) 


III funding 


No 


0 


0 


0 


48 



AMAO is annual measurable achievement objective. 
Source: Florida Department of Education 2008e. 



Georgia 

Georgia has seen rapid growth in its ELL student 
population in recent years. Over 1995/96-2005/06, 
the number of ELL students in K-12 public schools 
rose 252 percent (National Clearinghouse for 
English Language Acquisition 2009b). In 2007/08, 
5 percent of all public school students were identi- 
fied as ELL students (table E25). 

The most common languages spoken by Georgia’s 
ELL students in 2007/08 were (in order) Spanish 
(by far the most common), Vietnamese, Korean, 
other African languages, and Chinese (Georgia 
Department of Education 2008a). Georgia reported 
using five language instruction models to serve 
students in Title Ill-funded districts: sheltered 
instruction, content-based English as a second 
language, pull-out English as a second language, 
push-in English as a second language, and the 
Sheltered Instruction Observation Protocol (Georgia 
Department of Education 2008a; see appendix F). 

Numbers and types of Title III subgrantees. Georgia 
reported having 81 Title III subgrantees in 2007/08 
(table E26). 



English language proficiency assessment used. 

Georgia used ACCESS for ELLs to assess English 
language proficiency (Georgia Department of 
Education 2008c, 2009). (See tables E3 and E4 
for information on the format of the assessment, 
the language domains assessed, and the types 
of scores generated.) It had used this assessment 
since 2006. In 2007/08, 60,129 students served by 
Title III were assessed (Georgia Department of 
Education 2008a). 

AMAO 1. Georgia’s AMAO 1 definition grouped 
students into cohorts based on their previous 
year’s ACCESS for ELLs assessment score. 8 Stu- 
dents were placed into seven cohorts, which Geor- 
gia called performance bands, based on composite 
scores (table E27). 

Students were considered to have made progress if 
they met Georgia’s annual progress in English lan- 
guage acquisition target, requiring that students 
move from one performance band to the next (by 
increasing their ACCESS for ELLs overall compos- 
ite score by a certain amount) each year (Georgia 
Department of Education 2008c). For example, a 
student who scored 2.4 in 2006/07, in performance 



TABLE E25 

English language learner students and students receiving Title III services in Georgia, 2007/08 



Number of English language 
learner students enrolled in K-12 


Percentage of total enrollment identified 
as English language learner students 


Number of students receiving 
Title III services 


79,894 


5 


65,815 



Source: Georgia Department of Education n.d.b, 2008a, d; American Institutes for Research 2010b. 
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TABLE E26 

Title III subgrantees in Georgia, 2007/08 (number, unless otherwise noted) 



Title III 
subgrantees 


District 

subgrantees 


Consortium 

subgrantees 


Districts 
represented 
within the 
consortia 


Districts with 
access to Title 
III funding 


Total districts 


Districts with 
access to Title 
III funding 
(percent) 


81 


80 


1 


83 


163 


185 


88 



Source: Georgia Department of Education n.d.b, 2008d. 



TABLE E27 

Proficiency cohorts for AMAO 1 calculations in 
Georgia, 2007/08 



Proficiency cohort 
(performance band) 


ACCESS for ELLs overall 
composite score range 


1 


1. 0-2.2 


2 


2. 3-3. 3 


3 


3.4-3.9 


4 


4.0-4.3 


5 


4.4-4.6 


6 


4.7-4.9 


7 


5.0+ 



AMAO is annual measurable achievement objective; ACCESS for ELLs is 
Assessing Comprehension and Communication in English State-to-State 
for English Language Learners. 

Source: Georgia Department of Education 2009. 



band 2, would need to move to performance band 
3 (or higher) by scoring at least 3.4 on the assess- 
ment to demonstrate progress in 2007/08. 

Progress for the state and subgrantees was mea- 
sured by a single percentage target of students 
served by Title III making progress. Beginning in 
2007/08, when three consecutive years of ACCESS 
for ELLs data were available, Georgia created a 
“second look” criterion for district determinations. 



Districts not meeting the AMAO 1 target outright 
were considered to have met AMAO 1 if they dem- 
onstrated movement toward the target. Georgia 
and 96 percent of its subgrantees met AMAO 1 in 
2007/08 (table E28). 9 

AMAO 2. Georgia’s AMAO 2 definition grouped 
all ELL students together for calculations (Georgia 
Department of Education 2008c, 2009). Students 
were considered proficient if they received an 
overall ACCESS for ELLs composite score of 5.0 or 
higher on the tier C exam (Georgia Department 
of Education 2008c, 2009). A target percentage of 
students served by Title III had to reach profi- 
ciency at both the state and subgrantee levels. 

For subgrantees not meeting the target outright, 
AMAO 2 was considered met if the percentage 
of ELL students who exited ELL services during 
the year was above the state average (Georgia 
Department of Education 2008c, 2009). 10 Georgia 
and 90 percent of its subgrantees met AMAO 2 
(table E29). 

AMAO 3. To trigger the need for an AMAO 3 deter- 
mination, schools in Georgia had to have at least 40 
ELL students or enough to account for 10 percent 
of students enrolled in grades 3-8 and 11; schools 



TABLE E28 

AMAO 1 target and determinations in Georgia, 2007/08 



Students making progress (percent) 


Did state meet 


Subgrantees meeting AMAO 1 


Target 


Actual 


AMAO 1? 


Number 


Percent 


47.0 


64.1 


Yes 


78 


96 



AMAO is annual measurable achievement objective. 
Source: Georgia Department of Education 2008c,d. 
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TABLE E29 

AMAO 2 target and determinations in Georgia, 2007/08 



Students reaching proficiency (percent) 


Did state meet 


Subgrantees meeting AMAO 2 


Target 


Actual 


AMAO 2? 


Number 


Percent 


5.0 


12.6 


Yes 


73 


90 



AMAO is annual measurable achievement objective. 
Source: Georgia Department of Education 2008c,d. 



TABLE E30 

Target and reported participation rates on Title I 
adequate yearly progress tests in Georgia, 2007/08 
(percent) 



Target 


Assessment 


Reported 




Criterion-referenced 
competency test/math 


99.9 


95 


Criterion-referenced competency 
test/reading-English language arts 


99.0 


Georgia high school 
graduation test/math 


98.2 




Georgia high school graduation 
test/English language arts 


97.8 



Source: Georgia Department of Education n.d.c. 



TABLE E31 



Assessments used to measure Title 1 adequate 
yearly progress in Georgia, 2007/08 


Grade span 


Assessment 


3-8 a 


Criterion-referenced competency test 


High school 


Grade 11: Georgia high school 
graduation test 



a. An alternate assessment was used for students with severe cognitive 
disabilities. 

Source: Georgia Department of Education 2008b. 



TABLE E32 

Targets and reported results for Title I adequate yearly progress in reading/language arts and math in 
Georgia, 2007/08 (percent proficient or advanced) 



Grade or 


Reading/language arts 




Math 




grade span 


Target 


Reported 


Target 




Reported 


3-8 


73.3 


76.1 


59.5 




62.4 


11 


87.7 


59.8 


74.9 




54.5 



Source: Georgia Department of Education n.d.c. 



TABLE E33 

Second academic indicators of adequate yearly progress in Georgia, 2007/08 



Grade level 


Indicator 


Target 


Reported (percent) 


Elementary and 
middle school 


Attendance 


No more than 15 percent of students absent more than 
15 days 


3.8 


High school 


Graduation rate 


70 percent in current year 
or 

70 percent using a three-year average 
or 

10 percent progress over previous year (from minimum 
threshold of 50 percent) 


50.2 



Source: Georgia Department of Education, n.d.c, 2008b. 
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TABLE E34 

AMAO 3 accountability determinations in Georgia, 2007/08 





Districts with access to Title III funding 
with enough English language learner 
students to generate a Title 1 adequate 
yearly progress subgroup determination 


Number of districts with access to 
Title III funding without enough 
English language learner students 
to generate a Title 1 adequate yearly 


Total number of 
districts in state 


Did state meet 


Number meeting 


Percent meeting 


progress subgroup determination (no 


with access to 


AMAO 3? 


AMAO 3 


AMAO 3 


AMAO 3 determination reported) 


Title III funding 


No 


46 


92 


113 


163 



AMAO is annual measurable achievement objective. 

Source: Georgia Department of Education 2008d; Carol Johnson, ESOL/Title III Program Specialist, Georgia Department of Education, personal communica- 
tion, April 22, 2010. 



with 75 ELL students were required to show prog- 
ress on AMAO 3 regardless of the size of the school 
(Georgia Department of Education 2008b). More 
than 97 percent of Georgia students participated in 
the content area assessments (table E30). 

Georgia used two main instruments to measure 
student progress (table E31). 

Georgia met AMAO 3 in 2007/08. Among districts 
for which a determination was required, 46 per- 
cent met AMAO 3 (table E34). 



Mississippi 

Mississippi had the fewest ELL students in the 
Southeast Region, despite a 73 percent increase 
across K-12 public schools over 1995/96-2005/06 
(National Clearinghouse for English Language Ac- 
quisition 2009b). In 2007/08, 1 percent of all public 
school students was identified as ELL students 
(table E35). 

The five most common languages spoken by Mis- 
sissippi’s ELL students in 2007/08 were (in order) 
Spanish (by far the most common), Vietnamese, 
Arabic, Cantonese, and Chinese (Mississippi 
Department of Education 2008b). Mississippi 
reported using seven types of language instruction 
models to serve students in Title Ill-funded dis- 
tricts: transitional bilingual, developmental bilin- 
gual, heritage language, sheltered English instruc- 
tion, structured English immersion, content-based 
English as a second language, and pull-out English 



as a second language (Mississippi Department of 
Education 2008b; see appendix F). 

Numbers and types of Title III subgrantees. In 

2007/08, Mississippi reported having 23 Title III 
subgrantees (table E36). 

English language proficiency assessment used. To 

assess proficiency, Mississippi used a version of 
the Stanford English Language Proficiency Test 
(ELPT), modified expressly for the state’s use by 
Pearson (Mississippi Department of Education 
2006; K. Thompson, Director, Office of Research 
and Statistics, Mississippi Department of Educa- 
tion, personal communication, May 6, 2010). 11 
Mississippi had used this assessment since 2004. 
In 2007/08, 2,683 students served by Title III were 
administered the ELPT (Mississippi Department 
of Education 2008b). Table E37 provides basic 
information on the format of the assessment and 
language domains assessed. 



TABLE E35 

English language students and students receiving 
Title III services in Mississippi, 2007/08 



Number of 


Percentage of 
total enrollment 


Number of 


English language 


identified as 


students 


learner students 


English language 


receiving Title 


enrolled in K-12 


learner students 


III services 


5,428 


1 


4,664 



Source: Mississippi Department of Education 2008b; American Institutes 
for Research 2010b. 
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TABLE E36 

Title III subgrantees in Mississippi, 2007/08 (number, unless otherwise noted) 



Title III 
subgrantees 


District 

subgrantees 


Consortium 

subgrantees 


Districts with 
access to Title 
III funding 


Total districts 


Districts with 
access to Title III 
funding (percent) 


23 


23 


0 


23 


152 


15 



Source: Mississippi Department of Education 2008b. 



Table E38 provides information on the student 
scores provided by the ELPT assessment. 

AMAO 1. Mississippi’s AMAO 1 definition 
grouped students into two cohorts, based on the 
number of years they had been in a language 
instruction program: students with two years and 
students with three or more years (Mississippi De- 
partment of Education 2006). There was no cohort 
for one year, because students need two years of 
scores to calculate progress. Students were deter- 
mined to have made progress if they increased 
their overall score or their score on at least one of 
the ELPT language domains by at least one level 
from the previous year; students at the highest 
level (transitional) were expected to maintain that 

TABLE E37 

Grade spans and language domains assessed by 
the Stanford English Language Proficiency Test in 
Mississippi, 2007/08 



Grade spans 


Language domains 
assessed 


K-2, 3-5,6-8,9-12 


Listening, speaking. 




reading, writing, 




comprehension 



Source: Pearson n.d. 



level (Mississippi Department of Education 2006). 
Subgrantees and the state had to meet separate 
targets for each cohort. 

Table E39 shows Mississippi’s 2007/08 AMAO 1 
targets and reported determinations. Although 
there were two cohort targets, separate cohort per- 
centage results were not reported, because of how 
the state calculated determinations. For each sub- 
grantee (and the state), an index was created based 
on the two cohorts. If a cohort met the target ex- 
actly, its index was zero; if the cohort exceeded the 
target, its index was positive. If both cohorts met 
or exceeded their targets, the combined index was 
zero or positive, and the subgrantee was reported 
as having met AMAO 1. A negative value indicated 
that the targets were not met by both cohorts 
(K. Thompson, Director, Office of Research and 
Statistics, Mississippi Department of Education, 
personal communication, May 6, 2010). 

An additional criterion was also used: Mississippi 
considered any subgrantee with fewer than 40 
ELL students to have met the AMAO by default. 
This was the case for 16 of the 23 subgrantees 
(K. Thompson, Director, Office of Research and 
Statistics, Mississippi Department of Education, 



TABLE E38 

Types of scores generated by the Stanford English Language Proficiency Test in Mississippi, 2007/08 



Language domain scores 


Composite scores 


Proficiency levels 


Listening, speaking, reading, writing, 
comprehension 


Oral language 

(listening/speaking, or "social" score for 
students at prereading levels), total 


1: Preproduction 
2: Early production 
3: Emergent 
4: Intermediate 
5: High intermediate 
6: Transitional 



Source: Pearson n.d. 
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TABLE E39 

AMAO 1 targets and determinations in Mississippi, 2007/08 



Target percentage of 


Subgrantees meeting AMAO 1 




students making progress 


Number 


Percent 


Did state meet AMAO 1? 


2- year cohort: 68 

3- years-or-more cohort: 80 


23 


100 a 


No a 



AMAO is annual measurable achievement objective. 

a. Mississippi considered any subgrantee with fewer than 40 English language learner students to have met the AMAO by default. Combining the 7 sub- 
grantees that met AMAO 1 outright and the 16 that met by default, all 23 were reported as having met AMAO 1. When all 2,683 students statewide were 
aggregated, however, the state did not meet either target (K. Thompson, Director, Office of Research and Statistics, Mississippi Department of Education, 
personal communication, May 6, 2010; Mississippi Department of Education n.d.c). 

Source: Mississippi Department of Education 2006, 2008b. 



personal communication, May 6, 2010; Mississippi 
Department of Education n.d.c). 

AMAO 2. Mississippi’s AMAO 2 definition 
grouped students for calculations into three co- 
horts, based on how long they had been enrolled 
in a Title III language instruction program. The 
one-year cohort comprised students in their 
first full year of English language instruction, 
the two-year cohort comprised students in their 
second full year, and the three-or-more-year co- 
hort comprised those in their third full year and 
beyond (Mississippi Department of Education 
2006). Students were considered to be proficient 
when their ELPT total score was transitional 
(Mississippi Department of Education 2006). To 
meet AMAO 2, subgrantees and the state were 
required to ensure that a percentage of stu- 
dents served by Title III in each cohort reached 
proficiency. 



Table E40 shows Mississippi’s AMAO 2 targets 
and reported determinations for 2007/08. Al- 
though there were three cohort targets, separate 
cohort percentage results were not reported, 
because of how the state calculated determina- 
tions. For each subgrantee (and the state), an 
index was created across the three cohorts. If a 
cohort met the target exactly, its index was zero; 
if it exceeded the target, its index was positive. If 
all three cohorts met or exceeded their targets, 
the combined index was zero or positive, and the 
subgrantee was reported as meeting AMAO 2. A 
negative value indicated that the targets were not 
met by all three cohorts (K. Thompson, Director, 
Office of Research and Statistics, Mississippi De- 
partment of Education, personal communication, 
May 6, 2010). 

An additional criterion was also used: Mississippi 
considered any subgrantee with fewer than 40 



TABLE E40 

AMAO 2 targets and determinations in Mississippi, 2007/08 



Target percentage of students 

reaching proficiency 


Subgrantees meeting AMAO 2 
Number Percent 


Did state meet AMAO 2? 


1-year cohort: 37 








2-year cohort: 45 


19 


83 a 


Yes 


3-years-or-more cohort: 52 









AMAO is annual measurable achievement objective. 

a. Combining the 3 subgrantees that met AMAO 2 outright and the 16 that met it by default, 19 were reported as having met AMAO 2. When all students 
were aggregated, the state met the three cohort targets (K. Thompson, Director, Office of Research and Statistics, Mississippi Department of Education, 
personal communication, May 6, 2010; Y. Gilbert, Title III State Coordinator, Mississippi Department of Education, personal communication, May 6, 2010; Mis- 
sissippi Department of Education n.d.c). 

Source: Mississippi Department of Education 2006, 2008b. 
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ELL students to have met the AMAO by default. 
This was the case for 16 of the 23 subgrantees 
(K. Thompson, Director, Office of Research and 
Statistics, Mississippi Department of Education, 
personal communication, May 6, 2010; Y. Gilbert, 
Title III State Coordinator, Mississippi Depart- 
ment of Education, personal communication, 

May 6, 2010; Mississippi Department of Educa- 
tion n.d.c). 

AMAO 3. To trigger the need for an AMAO 3 
determination, schools in Mississippi had to have 

TABLE E41 

Target and reported participation rates on Title 
I adequate yearly progress tests in Mississippi, 
2007/08 (percent) 



Target 


Reported 


95 


99 



Source: Mississippi Department of Education n.d.c. 



at least 40 ELL students (Mississippi Department 
of Education 2008a). In 2007/08, 99 percent of ELL 
students in the state participated in the content 
area assessments, (table E41). 

Mississippi used two main instruments to mea- 
sure student progress (table E42). 



TABLE E42 



Assessments used to measure Title 1 adequate 
yearly progress in Mississippi, 2007/08 


Grade span 


Assessment 


3-8 a 


Mississippi curriculum test 


High school 


End-of-course assessments 
in algebra and English II 



a. An alternate assessment was used for students with severe cognitive 
disabilities. 



Source: K. Thompson, Director, Office of Research and Statistics, Missis- 
sippi Department of Education, personal communication, October 30, 
2009; Mississippi Department of Education 2008a. 



TABLE E43 

Targets and reported results for Title I adequate yearly progress in reading/language arts and math in 
Mississippi, 2007/08 (percent proficient or advanced) 





Reading/language arts 




Math 




Grade 


Target 




Reported 


Target 




Reported 


3 


37 




45 


42 




63 


4 


34 




36 


40 




55 


5 


34 




36 


37 




50 


6 


32 




31 


38 




45 


7 


28 




27 


37 




43 


8 


30 




26 


32 




50 






English II 






Algebra 1 




Grade 


Target 




Reported 


Target 




Reported 


9 








80 






10 


31 




1/13 


39 




63 b 


11 




Z4 


24 




12 








15 







na is not applicable. 

a. Mississippi used "English II data from the secondary grade span." No particular grade level for this course was stipulated (Mississippi Department of Educa- 
tion 2008a, p. 56). 

b. Mississippi did not report Algebra I scores for individual grades in 2007/08 (K. Thompson, Director, Office of Research and Statistics, Mississippi Depart- 
ment of Education, personal communication, October 30, 2009). 

Source: Mississippi Department of Education n.d.c, 2008a; K. Thompson, Director, Office of Research and Statistics, Mississippi Department of Education, 
personal communication, October 30, 2009. 
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TABLE E44 

Second academic indicators of adequate yearly progress in Mississippi, 2007/08 (percent) 



Grade level 


Indicator 


Target 


Reported 


Elementary and 
middle school 


Attendance 


93 

or 

Increase from previous year 


95 


High school 


Graduation rate 


72 

or 

Increase from previous year 


87 



Source: Mississippi Department of Education n.d.c. 



TABLE E45 

AMAO 3 accountability determinations in Mississippi, 2007/08 





Districts meeting AMAO 3 


Number of districts with 


Did state meet AMAO 3? 


Number 


Percent 


access to Title III funding 


Yes 


23 a 


100 a 


23 



AMA0 is annual measurable achievement objective. 

a. Mississippi considered any subgrantee with fewer than 40 English language learner students to have met the AMAO by default. Combining the 7 sub- 
grantees that met AMAO 1 outright and the 16 that met by default, all 23 subgrantees were reported as having met AMAO 3. 

Source: Mississippi Department of Education 2008b, n.d.c. 



Mississippi set targets for reading/language arts 
and math in grades 3-8 and English II and algebra 
for grades 9-12 (table E43). 

Mississippi reported AMAO 3 determinations 
differently from the other five states. Seven of 
its 23 district subgrantees met the AMAO for 
their English language learner student subgroup 
per Title I adequate yearly progress. Mississippi 
also reported the 16 district subgrantees without 
enough ELL students to generate a Title I adequate 
yearly progress subgroup determination as having 
met AMAO 3 (Mississippi Department of Educa- 
tion n.d.c; table E45). Hence, all 23 were reported 
as meeting AMAO 3. 



North Carolina 

North Carolina has experienced extremely rapid 
growth in its ELL K-12 student population in 
recent years, with the population growing 346 
percent over 1995/96-2005/06 (National Clearing- 
house for English Language Acquisition 2009b). 

In 2007/08, 8 percent of all public school students 
were identified as ELL students (table E46). 



The five most common languages spoken by North 
Carolina’s ELL students in 2007/08 were (in order) 
Spanish (by far the most common), Hmong, Viet- 
namese, Arabic (Egyptian), and Korean (North 
Carolina Department of Public Instruction 2008b). 
North Carolina reported using six language 
instructional models to serve students in Title 
Ill-funded districts: dual language, transitional 
bilingual, heritage language, sheltered instruc- 
tion, content-based English as a second language, 
and pull-out English as a second language (North 
Carolina Department of Public Instruction 2008b; 
see appendix F). 

Numbers and types of Title III subgrantees. North 
Carolina reported having 85 Title III subgrantees 
in 2007/08, including 2 consortia and 1 charter 
school (table E47). It was the only state that had a 
charter school as a Title III subgrantee. 

English language proficiency assessment used. To 

assess English proficiency for ELL students in 
2007/08, North Carolina used the IDEA English 
Language Proficiency Test (IPT; North Carolina 
State Board of Education 2008; North Carolina 
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TABLE E46 



English language learner students and students receiving Title III services in North Carolina, 2007/08 



Number of English language 
learner students enrolled in K-12 


Percentage of total enrollment identified 
as English language learner students 


Number of students that 
received Title III services 


114,620 


8 


113,011 



Source: North Carolina Department of Public Instruction 2008b; American Institutes for Research 2010b. 



TABLE E47 

Title III subgrantees in North Carolina, 2007/08 (number, unless otherwise noted) 



Title III 
subgrantees 


District 

subgrantees 


Consortium 

subgrantees 


Districts 
represented 
within the 
consortia 


Charter 

school 

subgrantees 


Districts with 
access to Title 

III funding Total districts 


Districts with 
access to Title 
III funding 
(percent) 


85 


82 


2 


14 


1 


96 115 


83 



Source: North Carolina Department of Public Instruction n.d.d, 2008b; H. Fasciano, Title III Director, North Carolina Department of Public Instruction, per- 
sonal communication, April 23, 2010. 



TABLE E48 

Grade spans and language domains assessed by the IDEA English Language Proficiency Test in North 
Carolina, 2007/08 



Grade or grade span 


Language domains assessed 


Kindergarten 


Reading/writing, listening/speaking 


1-2, 3-5, 6-8, 9-12 


Listening, speaking, reading, writing 



Source: Ballard and Tighe 2009' George Washington University Center for Equity and Excellence in Education n.d.; North Carolina Department of Public 
Instruction n.d.b, 2007. 



Department of Public Instruction 2008c), devel- 
oped by Ballard and Tighe. North Carolina had 
used this assessment since 2005. 12 In 2007/08, 
101,713 students served by Title III were adminis- 
tered the IPT. Table E48 provides basic informa- 
tion on the format of the assessment and language 
domains assessed. 

Table E49 provides information on the student 
scores provided by the IPT. 

AMAO 1. North Carolina’s AMAO 1 definition 
grouped all ELL students together for calculations. 
Students were determined to have made progress 
if they increased their score from the previous 
year by at least one level in at least one language 
domain (North Carolina State Board of Education 
2008). Progress for subgrantees and the state was 
achieved when a target percentage of all students 



served by Title III made progress (North Carolina 
State Board of Education 2008). North Carolina 
and all its subgrantees met AMAO 1 in 2007/08 
(table E50). 

AMAO 2. North Carolina’s AMAO 2 definition 
grouped students into cohorts by the number of 
years they had been in U.S. schools and included 
a cohort only for students that had been in U.S. 
schools for five years or more (with credit given 
for those attaining proficiency in less than five 
years; North Carolina State Board of Educa- 
tion 2008). Students were considered proficient 
if they achieved a score of superior in all four 
language domains on the test (North Carolina 
State Board of Education 2008). To meet AMAO 
2, the state and subgrantees had to meet the same 
target for the percentage of all relevant students 
who achieved proficiency (North Carolina State 
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TABLE E49 

Types of scores generated by the IDEA English Language Proficiency Test in North Carolina, 2007/08 



Grade or grade span 


Language domain scores 


Composite scores 


Proficiency levels 


Kindergarten 


Reading/writing 


Comprehension (listening/ 


1: Novice low 




Listening/speaking 


reading) 


2: Novice high 
3: Intermediate low 


1-12 


Listening, speaking, reading, 
writing 




4: Intermediate high 
5: Advanced 
6: Superior 



Source: Ballard and Tighe 2009; George Washington University Center for Equity and Excellence in Education n.d.; North Carolina Department of Public 
Instruction n.d.b, 2007; H. Fasciano, Title III Director, North Carolina Department of Public Instruction, personal communication, May 11, 2010. 



TABLE E50 

AMAO 1 target and determinations in North Carolina, 2007/08 



Students making progress (percent) 


Did state meet 


Subgrantees meeting AMAO 1 


Target 


Actual 


AMAO 1? 


Number 


Percent 


60.0 


84.1 


Yes 


85 


100 



AMAO is annual measurable achievement objective. 

Source: North Carolina Department of Instruction n.d.d, 2008b. 



Board of Education 2008). North Carolina and 45 
percent of its subgrantees met AMAO 2 in 2007/08 
(table E51). 

AMAO 3. To trigger the need for an AMAO 3 
determination, schools in North Carolina had 
to have at least 40 ELL students or enough stu- 
dents to account for 1 percent of total enrollment 
(whichever is greater; North Carolina Depart- 
ment of Public Instruction 2008a). In 2007/08, 

99 percent of ELL students in grades 3-8 in the 
state participated in content area assessments; in 
grade 10, 96 percent participated in the reading 
assessment and 95 percent in the math assessment 
(table E52). 



North Carolina used a variety of instruments to 
measure student progress (table E53). 

TABLE E52 

Target and reported participation rates on Title I 
adequate yearly progress test in North Carolina, 
2007/08 





Reported 




Target 


Subject/ 
grade level 


Percent 




Reading 3-8 


99 


95 


Math 3-8 


99 


Reading 10 


96 




Math 10 


95 



Source: North Carolina Department of Instruction n.d.e. 



TABLE E51 

AMAO 2 target and determinations in North Carolina, 2007/08 



Students reaching proficiency (in U.S. 
schools for five or more years; percent) 


Did state meet 


Subgrantees meeting AMAO 2 


Target 


Actual 


AMAO 2? 


Number 


Percent 


17 


19 


Yes 


38 


45 



AMAO is annual measurable achievement objective. 

Source: North Carolina Department of Instruction n.d.d, 2008b. 
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TABLE E53 

Assessments used to measure Title I adequate 
yearly progress in North Carolina, 2007/08 



Grade span 


Assessment 


3-8 a 


End-of-grade assessments 


High school 


Grade 10: math (Algebra 1 end-of- 
course assessment) 




English 1: end-of-course assessments 
Grade 10: writing assessment 



The state’s student achievement targets were then 
set for the percentages of students reaching pro- 
ficient or advanced in reading/language arts and 
math (table E54). 

North Carolina did not meet AMAO 3 for 2007/08 
(table E56). 



a. An alternate assessment was used for students with severe cognitive 
disabilities. 

Source: North Carolina Department of Instruction n.d.e. 



TABLE E54 

Targets and reported results for Title I adequate yearly progress in reading/language arts and math in North 
Carolina, 2007/08 (percent proficient or advanced) 



Grade or 


Reading/language arts 




Math 




grade span 


Target 


Reported 


Target 




Reported 


3-8 


43.2 


23.1 


77.2 




51.9 


10 


38.5 


27.5 


68.4 




49.2 



Note: North Carolina used a number of instruments to assess progress of high school students. The state reported determinations for all assessments under 
the generic discipline areas of reading/language arts and math. 

Source: North Carolina Department of Public Instruction n.d.e. 



TABLE E55 

Second academic indicators of adequate yearly progress in North Carolina, 2007/08 



Grade level 


Indicator 


Target 


Reported (percent) 


Elementary and 
middle school 


Attendance 


A more than 0.1 percentage point increase from 
previous year up to 90 percent 
or 

Any annual fluctuation over 90 percent 


96.2 


High school 


Graduation rate 


A more than 0.1 percentage point from previous 
year up to 80 percent 
or 

Any annual fluctuation over 80 percent 


49.9 



Source: North Carolina Department of Instruction n.d.e, 2008a. 



TABLE E56 

AMAO 3 accountability determinations in North Carolina, 2007/08 



Did state 


Districts with access to Title III funding 
with enough English language learner 
students to generate a Title 1 adequate 
yearly progress subgroup determination 


Number of districts with access to 
Title III funding without enough 
English language learner students 
to generate a Title 1 adequate yearly 
progress subgroup determination (no 
AMAO 3 determination reported) 


Number of districts 


meet 
AMAO 3? 


Number meeting 
AMAO 3 


Percent meeting 
AMAO 3 


with access to 
Title III funding 


No 


7 


8.2 


12 


96 



AMAO is annual measurable achievement objective. 

Source: North Carolina Department of Instruction n.d.d.e, 2008b; H. Fasciano, Title III Director, North Carolina Department of Public Instruction, personal 
communication, April 23, 2010. 
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South Carolina 

South Carolina experienced the fastest growth 
of all Southeast Region states in its public school 
K-12 ELL student population in recent years, reg- 
istering an increase of 688 percent over 1995/96— 
2005/06 (National Clearinghouse for English Lan- 
guage Acquisition 2009b). In 2007/08, 4 percent of 
all public school students in South Carolina were 
identified as ELL students (table E57). 

The five most common languages spoken by South 
Carolina’s ELL students in 2007/08 were (in order) 
Spanish, Russian, Vietnamese, Portuguese, and 
Arabic (South Carolina Department of Education 
2008b). South Carolina reported using six language 
instruction models to serve these students in Title 
Ill-funded districts: dual language, sheltered English 
instruction, structured English immersion, specially 
designed academic instruction in English, content- 
based English as a second language, and pull-out 
English as a second language (South Carolina De- 
partment of Education 2008b; see appendix F). 

Numbers and types of Title III subgrantees. In 

2007/08, South Carolina reported having 44 Title 
III subgrantees (table E58). 

English language proficiency assessment used. South 
Carolina used the English Language Development 



Assessment (ELDA) to assess the English profi- 
ciency of ELL students in 2007/08 (South Caro- 
lina Department of Education n.d.e). ELDA was 
developed by a consortium of 15 states that were 
members of the Limited English Proficiency State 
Consortium for Assessment and Student Standards 
hosted by the Council of Chief State School Officers, 
in collaboration with the American Institutes for 
Research, the Center for the Study of Assessment 
Validity and Evaluation at the University of Mary- 
land, and Measurement Incorporated (Council of 
Chief State School Officers 2005). South Carolina 
had used this assessment for grades 3-12 since 
2005 and for K-2 since 2006. In 2007/08, 28,129 
students served by Title III were administered the 
ELDA. Table E59 provides basic information on the 
grade spans and language domains assessed. 

Table E60 provides information of the student 
scores provided by the ELDA. 

AMAO 1. South Carolina’s AMAO 1 definition 
grouped all ELL students together for calculations 
(South Carolina Department of Education n.d.e). Stu- 
dents were considered to have made progress if they 
increased their overall composite score on the ELDA 
one level from the previous year (South Carolina 
Department of Education n.d.e). Subgrantees and the 
state were required to meet a single target percentage 
of all students served by Title III (South Carolina 



TABLE E57 

English language students and students receiving Title III services in South Carolina, 2007/08 



Number of English language 
learner students enrolled in K-12 


Percentage of total enrollment identified 
as English language learner students 


Number of students receiving 
Title III services 


29,907 


4 


27,244 



Source: South Carolina Department of Education 2008b; American Institutes for Research 2010b. 



TABLE E58 

Title III subgrantees in South Carolina, 2007/08 (number, unless otherwise noted) 



Title III 
subgrantees 


District 

subgrantees 


Consortium 

subgrantees 


Districts 
represented 
within the 
consortia 


Districts with 
access to Title 
III funding 


Total districts 


Districts with 
access to Title 
III funding 
(percent) 


44 


37 


7 


30 


67 


85 


79 



Source: South Carolina Department of Education 2008 c,d,e. 





42 



TITLE III ACCOUNTABILITY POLICIES AND OUTCOMES FOR K-12 



TABLE E59 

Grade spans and language domains assessed by 
the English Language Development Assessment 
in South Carolina, 2007/08 





Language domains 


Grade spans 


assessed 


K-2, 3-5,6-8,9-12 


Listening, speaking. 




reading, writing 



Source: Council of Chief State School Officers 2005; South Carolina 
Department of Education n.d.e, d, 2009a, b. 



Department of Education 2008c). The state and 
100 percent of its subgrantees met the target 
(table E61). 

AMAO 2. South Carolina’s AMAO 2 definition 
grouped all students together for calculations 
(South Carolina Department of Education n.d.e). 
Students were categorized as proficient if they at- 
tained an overall composite score proficiency level 
of 5 on the ELDA (South Carolina Department of 
Education n.d.e). Subgrantees and the state were 
required to meet a single target percentage of stu- 
dents reaching proficiency. The state and 100 per- 
cent of its subgrantees met the target (table E62). 



TABLE E60 

Types of scores generated by the English 
Language Development Assessment in South 
Carolina, 2007/08 



Language 
domain scores 


Composite 

scores 


Proficiency levels 


Listening, 
speaking, 
reading, writing 


Comprehension 
(listening/ 
reading), overall 


0-1: Prefunctional 
2: Beginning 
3: Intermediate 
4: Advanced 
5: Fluent English 
proficient 



Source: Council of Chief State School Officers 2005; South Carolina 
Department of Education n.d.c,d, 2009a, b. 



at least 40 ELL students (South Carolina Depart- 
ment of Education 2008a). More than 99 percent of 
students participated in the content area assess- 
ments (table E63). 

South Carolina used two main instruments to 
measure student progress (table E64). 

The state’s student achievement targets were set for 
the percentages of students reaching proficient or 
advanced (table E65). 



AMAO 3. To trigger the need for an AMAO 3 de- South Carolina did not meet AMAO 3 in 2007/08 

termination, schools in South Carolina had to have (table E67). 



TABLE E61 

AMAO 1 target and determinations in South Carolina, 2007/08 



Students making progress (percent) 


Did state meet 


Subgrantees meeting AMAO 1 


Target 


Actual 


AMAO 1? 


Number 


Percent 


20.0 


37.2 


Yes 


44 


100 



AMAO is annual measurable achievement objective. 
Source: South Carolina Department of Education 2008b, c. 



TABLE E62 

AMAO 2 target and determinations in South Carolina, 2007/08 



Students reaching proficiency (percent) 


Did state meet 


Subgrantees meeting AMAO 2 


Target 


Actual 


AMAO 2? 


Number 


Percent 


0.5 


7.8 


Yes 


44 


100 



AMAO is annual measurable achievement objective. 

Source: South Carolina Department of Education 2008b, d, n.d.e. 
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TABLE E63 

Target and reported participation rates on Title I 
adequate yearly progress tests in South Carolina, 
2007/08 (percent) 



Target 


Reported 


95 


English language arts: 99.1 


Math: 99.8 



Source: South Carolina Department of Education n.d.f, 2008a. 



TABLE E64 



Assessments used to measure Title 1 adequate 
yearly progress in South Carolina, 2007/08 


Grade span 


Assessment 


3-8 a 


Palmetto Achievement 
Challenge Test 


High school 


High School Assessment 
Program 



a. An alternate assessment was used for students with severe cognitive 
disabilities. 

Source: South Carolina Department of Education 2008a. 



TABLE E65 

Targets and reported results for Title I adequate yearly progress in reading/language arts and math in South 
Carolina, 2007/08 





Reading/language arts 




Math 




Grade span 


Target 


Reported 


Target 




Reported 


3-8 and 9-12 


45.8 


37.8 


42.7 




40.0 



Source: South Carolina Department of Education n.d.f., 2008a. 



TABLE E66 

Second academic indicators of adequate yearly progress in South Carolina, 2007/08 



Grade level 


Indicator 


Target 


Reported (percent) 


Elementary and 


Attendance 


94 percent 


96.6 


middle school 




or 








0.1 percentage point improvement on school or district's 
previous year's attendance rate 




High schools 


Graduation rate 


Met or exceeded previous year 
or 

Average over three years (current year and two previous 
academic years, when three years of data are available) meets 
or exceeds previous year 
or 

Meets or exceeds 88.3 percent 


61.7 



Source: South Carolina Department of Education n.d.f, 2008a. 



TABLE E67 

AMAO 3 accountability determinations in South Carolina, 2007/08 





Districts with access to Title III funding 
with enough English language learner 
students to generate a Title 1 adequate 
yearly progress subgroup determination 


Number of districts with access to 
Title III funding without enough 
English language learner students 
to generate a Title 1 adequate yearly 


Number of 
districts with 


Did state meet 
AMAO 3? 


Number meeting 
AMAO 3 


Percent meeting 
AMAO 3 


progress subgroup determination (no 
AMAO 3 determination reported) 


access to Title 
III funding 


No 


26 


68.4 


29 


67 



AMAO is annual measurable achievement objective. 
Source: South Carolina Department of Education 2008b, e. 
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APPENDIX F 

FEATURES OF INSTRUCTION MODELS, 2007/08 

The consolidated performance reports submit- 
ted by the states in 2007/08 did not describe their 
language instruction programs. To provide some 
context on what these programs might entail, 
the following definitions are adapted primarily 
from the most recent Title III Biennial Report to 
Congress, 2004-06 (Office of English Language 
Acquisition 2008). Information on inclusion/ 
mainstream is from the Florida Department of 
Education (n.d.e). Information on submersion is 
from Leung and Franson (1989); Skutnabb-Kangas 
(1991); and Swain and Johnson (1997), as cited in 
Fazio and Lyster (1998) 



Models developing literacy in English only 

Specially Designed Academic Instruction in 

English, content/core-based English as a second 

language, Sheltered Instruction Observational Pro- 
tocol, and sheltered English instruction (core/basic) 

• Students learn content in an all-English 
setting. 

• Students from various linguistic backgrounds 
can be in the same class. 

• Instruction is adapted to students’ proficiency 
levels and supplemented by gestures, visual 
aids, and other scaffolding techniques. 

Structured English immersion 

• Students learn content in an all-English set- 
ting, with only ELL students in the class. 

• All instruction is in English, adjusted to the 
proficiency level of students so that subject 
matter is comprehensible, using sheltered 
instruction techniques. 



Pull-out English as a second language/English 

language development 

• Students leave their mainstream classroom to 
spend part of the day receiving English as a 
second language instruction, which often fo- 
cuses on grammar, vocabulary, and commu- 
nication skills in English but not on academic 
content. 

• There is typically no support for students’ na- 
tive languages. 

Push-in English as a second language 

• Students are served in a mainstream class- 
room, receiving instruction in English and 
possibly some native language support. 

• The English as a second language teacher or 
an instructional aide provides clarification 
(and translation if needed) and uses English 
as a second language strategies. 

Inclusion; mainstream (English/core/basic) 

• Instruction takes place in the mainstream 
classroom rather than in self-contained Eng- 
lish for Speakers of Other Languages (ESOL) 
or bilingual classrooms. 

• Students are provided with comprehensible 
instruction using either the students’ native 
languages or ESOL strategies. 

Submersion 

• Instruction is entirely in English, with no at- 
tempt made to scaffold instruction. 

• Teachers usually do not speak students’ pri- 
mary languages. 



Teachers need receptive skill in “to under- 
stand” students’ first language. 
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Models developing literacy in two languages 

Two-way immersion or two-way bilingual 

• Classes include students with an English 
language background and students from one 
other language background. 

• Instruction is in both languages, typically 
starting with a smaller proportion of instruc- 
tion in English and gradually moving to half 
the instruction in each language. 

• Students typically stay in the program 
throughout elementary school. 

Dual language 

• “Dual language immersion” usually refers 
to two-way immersion or two-way bilingual 
education. 

• “Dual language” refers to students from one 
language group who develop full literacy skills 
in their native language and English. 



Heritage language instruction 

• Content is taught in English and the students’ 
native languages, by teachers fluent in both 
languages. 

• Instruction typically targets students who 
are non-English speakers or who have weak 
literacy skills in their native language. 

• Instruction can support endangered minority 
languages. 

Transitional bilingual, developmental bilingual, 

late exit transitional, early exit transitional, and 

one-way developmental bilingual 

• Instruction at lower grades is in students’ 
native languages, gradually transitioning to 
English; students typically transition into 
mainstream classrooms with their English- 
speaking peers. 

• Differences among programs focus on the 
degree of literacy students develop in their na- 
tive languages and how long they spend in the 
bilingual classroom before transitioning. 
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NOTES 

1 . 



2 . 



3. 



States must hold their subgrantees account- 
able for meeting their AMAOs (No Child Left 
Behind 2002d). If a subgrantee fails to meet 
the three AMAOs for two consecutive years, 
the state education agency must require the 
subgrantee to develop an improvement plan 
specifying how the subgrantee will work to 
meet the AMAOs, provide technical assistance 
to the subgrantee, and develop collabora- 
tive professional development strategies and 
activities, grounded in scientific research. If a 
subgrantee fails to meet the AMAOs for four 
consecutive years, the state education agency 
must require the subgrantee to modify the 
curriculum, program, and method of instruc- 
tion, make a determination regarding whether 
the subgrantee may continue to receive Title 
III funding, and require the subgrantee to 
replace education personnel involved with 
failing to meet the objectives. 

Acquiring a new language for academic 
purposes takes a long time. Some experts have 
posited a typical timeframe of four to five full 
academic years (for example, Working Group 
on ELL Policy 2010), but debate continues 
on the issue (see, for example, Collier 1995; 
Hakuta, Butler, and Witt 2000). 

This study does not address why states defined 
their AMAOs the way they did. It may be 
that these states decided to include only these 
cohorts of students in AMAO 2, based on 
the assumption that students need at least 
three to five years in a language instruction 
program to reach full proficiency. (That is, 
students with fewer years would not yet have 
had enough time to make enough progress to 
be expected to reach full proficiency by the 
end of a school year.) 

State adequate yearly progress plans have 
multiple levels of detail, beyond the scope of 
this report. This report helps readers under- 
stand the expectations on states and districts 



with access to Title III funds for AMAO 3 
accountability; it does not explain state Title I 
accountability plans in detail. Readers inter- 
ested in states’ full adequate yearly progress 
plans can find the source documents in the 
state-specific resources used in the document 
review section of the references. 

5. These requirements are flexible for the par- 
ticipation (and scores) of some ELL students. 
According to the 2006 amended regulations 
to the Elementary and Secondary Education 
Act Title I Part A (Federal Register 2006) and 
the nonregulatory guidance on these regula- 
tions (U.S. Department of Education 2007), 
“recently arrived LEP” students were defined 
as ELL students who have attended schools 
in the United States for less than 12 months. 
States could choose to exempt these students 
from one (and only one) administration of 
the state’s reading/language arts assessment. 
These students are required to take the state’s 
English language proficiency assessment, 
which could count as participation toward 
the 95 percent participation requirement for 
reading/language arts. Recently arrived ELL 
students had to take their state’s math assess- 
ment. (No exemption was provided.) States 
could, however, exclude the scores of these stu- 
dents on the math and the reading/language 
arts assessment (if taken) from one (and only 
one) cycle of adequate yearly progress determi- 
nations. Additionally, “former LEPs” (former 
ELL students) were defined as students who 
were identified as ELL students at some point 
in the previous two years but who no longer 
met the state’s definition of an ELL student. 
States could include these students in the ELL 
student subgroup when calculating adequate 
yearly progress determinations for up to two 
years after the students were no longer ELL 
students. However, states could not include 
these students in the ELL student subgroup for 
calculating the participation rate. 

6. The state may have decided to include only 
this cohort of students in AMAO 2 based on 



NOTES 



47 



the assumption that students need at least five 
years in a language instruction program to 
reach full proficiency (that is, students who re- 
ceived less than five years’ instruction would 
not yet have had enough time to reach full 
proficiency by the end of the school year). This 
study does not address the question of why 
states defined their AMAOs the way they did. 
The assumption discussed here is included 
simply to give context for thinking about this 
type of grouping of students for AMAO 2. The 
literature cited in the why this study section of 
this report provides more information. 

7. The state may have decided to include only 
this cohort of students in AMAO 2 based on 
the assumption that students need at least five 
years in a language instruction program to 
reach full proficiency (that is, students who re- 
ceived less than five years’ instruction would 
not yet have had enough time to reach full 
proficiency by the end of the school year). This 
study does not address the question of why 
states defined their AMAOs the way they did. 
The assumption discussed here is included 
simply to give context for thinking about this 
type of grouping of students for AMAO 2. The 
literature cited in the why this study section of 
this report provides more information. 

8. Students were included in cohorts only if 
present for the “full academic year” (present 
at both the fall and spring full-time equiva- 
lent attendance counts), the same mechanism 



used to determine state education funding for 
local school systems (Georgia Department of 
Education 2008c, 2009). After 2007/08, Geor- 
gia eliminated the full academic year require- 
ment from AMAO 1 determinations (Georgia 
Department of Education 2009). 

9. In 2009, Georgia modified its AMAO 1 policy 
to remove this second look provision (Georgia 
Department of Education 2009). 

10. According to Georgia State Board of Educa- 
tion rule 160-4-5-.02, students can exit ELL 
student services by scoring proficient on 
ACCESS for ELLs and on the state reading as- 
sessment or scoring proficient on one of these 
assessments and being evaluated by a lan- 
guage assessment committee that deems them 
ready to exit services (Georgia State Board of 
Education 2006). 

11. In 2008, Mississippi adopted ACCESS for 
ELLs for use beginning in 2008/09 (WIDA 
2009c). In 2007/08, Mississippi acquired its 
assessment materials from Harcourt Assess- 
ment, Inc. (Y. Gilbert, personal communica- 
tion, May 6, 2010; Mississippi Department of 
Education 2007). 

12. In 2008, North Carolina joined the World- 
Class Instructional Design and Assessment 
(WIDA) Consortium and adapted ACCESS for 
ELLs for use beginning school year 2008/09 
(WIDA Consortium 2008). 
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